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Why OIG Did This Review 
The Office of Inspector General 
(OIG) conducted this review to 
estimate the incidence of patient 
harm events in Indian Health 
Service (IHS) hospitals and to 
assess the extent to which these 
events were preventable. 


IHS provides comprehensive 
Federal health services to 
approximately 2.6 million American 
Indians and Alaska Natives. In 
fiscal year (FY) 2017, IHS provided 
acute-care services at 26 hospitals 
located predominately in remote 
areas across the country. Most of 
these hospitals are small, with few 
inpatient beds. Compared to 
acute-care hospitals nationally, IHS 
hospitals have lower patient 
volume, provide less clinically 
complex care, and have shorter 
average lengths of stay. 


Prior OIG reports have identified 
longstanding challenges to |HS’s 
ability to deliver safe and 
high-quality health care to 
American Indians and Alaska 
Natives—a medically vulnerable 
population with poorer health 
outcomes and barriers to accessing 
health care, especially among those 
aged 65 and older. Challenges 
faced by IHS hospitals include 
staffing shortages and lack of 
specialty care. IHS hospitals in the 
agency's Great Plains Area are a 
location of particular concern for 
these issues. 


This report is part of an OIG series 
of reports about adverse events in 
health care settings and continues 
OIG's commitment to monitoring 

the quality of care at IHS facilities. 
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Key Takeaway 


An estimated 13 percent of 
patients in IHS hospitals 
experienced patient harm 
events, with higher rates of 
harm in smaller hospitals. 
Within our sample, harm events 
were more prevalent among 
older adults and labor and 
delivery patients, and about half 
of events were preventable—i.e., 
they could have been avoided if 
patients had been given better 
care. We recommend that IHS 
establish patient harm 
monitoring and reduction as a 
key priority of its Office of 
Quality; effectively track and 
monitor harm events; and 
implement quality improvement 
plans both across IHS and 
targeted to smaller hospitals 
and patient groups at greater 
risk of harm. 





What OIG Found 

An estimated 13 percent of patients 
experienced patient harm events (i.e., 
harm to a patient as a result of medical 
care). Patient harm events include 
adverse events and temporary harm 
events that occurred during IHS hospital 
stays in FY 2017. 


Patients who experienced patient harm 
events fell into two categories: 


> A percent of patients experienced 
adverse events, i.e., harm events 
that resulted in a prolonged hospital 
stay, permanent patient harm, life 
sustaining intervention, or 
contributed to death; and an 
additional 


> 8 percent of patients experienced 
temporary harm events, i.e., harm 
events that did not result in a 
prolonged hospital stay or cause 
lasting harm. 


(Note: Because of rounding the above 
rates do not add to 13 percent.) 


Hospital Location and Size. We did not find higher rates of patient harm 
events in IHS hospitals in the agency's Great Plains Area—a location of 
concern because of past quality-of-care problems. With regard to hospital 
size, the rate of patient harm was significantly higher among smaller IHS 


hospitals nationwide: 


> 19 percent of patients experienced patient harm events in smaller IHS 
hospitals (those with fewer than 1,000 admissions in FY 2017), whereas 


> 9 percent of patients experienced patient harm events in larger IHS 
hospitals (those with 1,000 or more admissions in FY 2017). 


Event Type and Clinical Category. Most of the patient harm events we 
identified in our sample were temporary harm events, and more than half of 
patient harm events were related to the use of medication. Few events in our 
sample related to procedures or infections. 
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How OIG Did This Review 
We selected a stratified random 
sample of 400 patients, from 
pediatric patients to older adults, 
who were admitted to 1 or more of 
the 26 IHS hospitals during 

FY 2017. The final sample 
consisted of 384 patients because 
of a small number of ineligible 
admissions and missing records. 


We drew patients for our sample 
from six strata that were based on 
hospital location and size. This 
sample design enabled us to 
ensure that the sample included a 
range of small hospitals, that it did 
not require a high number of 
records from large hospitals, and 
that we could make projections to 
the Great Plains Area. 


We calculated the incidence rate of 
patient harm events in IHS 
hospitals from a review of patients’ 
medical records. Clinicians 
reviewed each patient's medical 
records to identify patient harm 
events and to assess the extent to 
which these events were 
preventable. We conducted the 
review in two stages. 


Stage 1: Nurses screened the 
records for possible patient harm 
events using a “trigger tool 
method.” A “trigger” is a clinical 
clue—for example, documentation 
of a fall—that may indicate harm. 


Stage 2: Physician-reviewers 
conducted a full review of the 
records flagged by nurses as 
containing possible harm events. 
Physician-reviewers identified harm 
events and assessed the level of 
harm, whether events were 
preventable, and factors that 
contributed to events. 


Patient Type. The proportion of patients experiencing harm events varied by 
patient type (e.g., age or reason for admission). In our sample, a higher 
proportion of older adults (aged 65 and older) and labor and delivery 
patients (any age) experienced harm events, whereas pediatric patients (up to 
and including 17 years of age) had 
fewer harm events. We found the 
following breakdown by patient type 
in our sample: 


Labor and Delivery Patients 
A companion report titled 
Instances of IHS Labor and 
Delivery Care Not Following 
National Clinical Guidelines or 
Best Practices (OEl-06-19-00190) 
found that over half of the 48 IHS 
labor and delivery patients in the 
sample experienced care that did 
not follow national clinical 
guidelines or best practices. 


> 30 percent of older adults 
experienced patient harm events, 


> 21 percent of labor and delivery 
patients experienced patient 
harm events, and 


> 5 percent of pediatric patients 
experienced patient harm events. 


(Note: These proportions are unweighted. About 15 percent of adults aged 
18 to 64 experienced patient harm events, but this did not appear to 
substantially vary from the overall 13 percent harm rate.) 


Most patient harm events in our sample occurred in smaller hospitals or 
involved either older adults or labor and delivery patients. At least one of 
these characteristics was present in 68 of the 79 patient harm events. 


Preventability. An estimated 7 percent of patients overall—slightly over half 
of the 13 percent of patients who experienced harm events—experienced 
events that could have been prevented if the patients had been given better 
care. Preventable events were often related to medical errors and 
substandard care (i.e. the failure to provide care according to national clinical 
guidelines). We determined that events were not preventable when other 
factors were involved in the harm, such as patients” being highly susceptibility 
to harm events because of poor health. 


What OIG Recommends and How the Agency Responded 

In an effort to reduce patient harm, OIG recommends that IHS’s Office of 
Quality establish patient harm monitoring and reduction as a key priority. 
IHS should also effectively track and monitor patient harm events using an 
improved and fully implemented incident reporting system. We further 
recommend that IHS implement quality improvement plans to improve 
patient safety across IHS, including plans that specifically focus on smaller 
hospitals and patient groups at higher risk of harm. IHS concurred with our 
recommendations and affirmed that patient safety is a high priority for the 
agency. Actions reported by IHS included enhanced partnerships, such as 
with the Centers for Medicare & Medicaid Services and the Agency for 
Healthcare Research and Quality, further hospital adoption of quality 
improvement and compliance plans, and implementation in 2020 of its new 
incident reporting system, I-STAR, across all IHS Areas and facilities. 
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BACKGROUND 





Objectives 


1. To estimate the incidence of adverse events and temporary harm events 
among patients in Indian Health Service (IHS) hospitals. 


2. To assess the extent to which these adverse events and temporary harm 
events were preventable and to identify factors contributing to these events. 





Adverse Events and Temporary Harm Events in Health Care 


The term “adverse event” describes harm to a patient as a result of medical care or in 
a health care setting, including the failure to provide needed care. An adverse event 
indicates that care resulted in an undesirable clinical outcome—an outcome not 
caused by underlying disease—that prolonged the patient stay; caused permanent 
patient harm; required life-saving intervention; or contributed to death. We also 
identify “temporary harm events,” which are events that resulted in patient harm and 
required medical intervention but did not cause lasting harm and are often less severe 
than adverse events. In this report, we sometimes use the term “patient harm events” 
to refer collectively to adverse events and temporary harm events. 


Adverse events and temporary harm events include medical errors and general 
substandard care that result in patient harm, such as failing to recognize and treat 
patients’ infections. However, adverse events and temporary harm events do not 
always involve errors, negligence, or poor quality of care, and as a result they are not 
always preventable—for example, an allergic reaction might not have been 
preventable if it was unexpected.' The Institute for Healthcare Improvement (IHI), a 
nonprofit advisory group dedicated to improving health and health care worldwide, 
further explains that “unpreventable events are only an innovation away from being 
preventable” and that including all causes of harm in research allows for better 
comparisons over time.” All-cause harm includes “any event during the care process 
that results in harm to a patient, regardless of the cause.”* 


Prior Studies of Adverse Events 


Reducing the incidence of adverse events is a critical step to improving patient safety 
and quality care. In 2000, the Institute of Medicine (IOM) report, To Err Is Human: 
Building a Safer Health System, focused widespread attention on the problem of 
adverse events.* IOM cited two medical record reviews to identify adverse events and 
assess whether events were preventable. The studies found that between 2.9 and 
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3.7 percent of hospitalized patients experienced these events and caused “at least 


15,6, 7 


44,000 and perhaps as many as 98,000 deaths in hospitals each year. 


Beginning in 2008, the Office of Inspector General (OIG) has released a series of 
reports regarding adverse events, including five reports that estimated the incidence 
rates of adverse events in various health care settings.® In a 2010 study, OIG found 
that 27 percent of hospitalized Medicare beneficiaries experienced adverse events or 
temporary harm events and that about half of these events were preventable.” 


Each of the OIG studies used a methodology that included screening records for 
potential patient harm events using the Global Trigger Tool (GTT), followed by a full 
physician review to identify events. The GTT is a systematic screening of records to 
look for “triggers” (clinical clues) that may indicate patient harm.* In a 2012 follow- 
up report, OIG found that hospital staff did not identify and report 86 percent of 
adverse events and temporary harm events to their hospitals’ incident reporting 


systems." 


Other researchers have used variations of GTT methodologies, finding estimated harm 


rates ranging from 9 percent to 33 percent (see Exhibit 1). 


Exhibit 1: Selected Patient Safety Research in Hospitals Using the Global Trigger Tool 





Study 


Description 


Harm Rate 





Office of Inspector 


General? (2010) 


Landrigan, et ale 


(2010) 


14 
Classen, et al. 


(2011) 


Kirkendall, et ale 


(2012) 


Kennerly, et al. 16 
(2014) 


Adler, et al.” 
(2018) 


Griffey, et al.'® 


(2018) 


Stockwell, et al? 


(2018) 


OIG randomly selected 780 Medicare beneficiaries from a national sample of Medicare-certified 
hospitals in October 2008. OIG identified 302 harm events (174 temporary harm events) using 
an OlG-modified version of the GTT. 


Researchers randomly selected 2,341 adult patient admissions from 10 hospitals between 2002 
and 2007. They identified 588 events (including those present on admission (POA)) across 
423 patient admissions using the IHI GTT. 


Researchers randomly selected 795 adult patient admissions from 3 hospitals during 
October 2004. They identified 393 events (354 identified using the IHI GTT). 


Researchers randomly selected 240 pediatric admissions from a hospital medical center in 2009. 
They identified 88 harm events (74 events were not POA) across 62 patients using the IHI GTT. 


Researchers randomly selected 9,017 adult patient encounters from 8 hospitals from a health 
care system between 2007 and 2011. They identified 3,430 events (2,129 events not POA) using 
the IHI GTT. 


Researchers randomly selected 21,007 adult patient records from 24 hospitals in a large 
multistate health system from 2009 to 2012. They identified 2,579 patients with adverse events 
and 2,818 patients with temporary harm events using the IHI GTT. 


Researchers randomly selected 2,594 adult patient records from four emergency departments 
(EDs) from 2016 to 2017. They identified 240 events (72 events involving patient harm and not 
POA) using an ED Trigger Tool. 


Researchers randomly selected 3,790 pediatric patient records from 16 hospitals from 2007 to 
2012. They identified 414 adverse events (210 preventable adverse events) using the Global 
Assessment of Pediatric Patient Safety (GAPPS) Trigger Tool. 


27% of patients 


(13.5% of patients— 
temporary harm) 


18% of patient 
admissions (including 
POA) 


33% of patient 
admissions 


26% of patients 
(including POA) 


21% of admissions 
(33% of admissions 
including POA) 
26% of patients 


(13.4% of patients— 
temporary harm) 


9% of ED visits 
(including POA) 


11% of patients* 
(including POA) 


*The incidence rate of 11 percent was not specifically included in the article. We calculated 11 percent using numbers presented in the article. 
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This OIG study continues our series on patient harm by estimating the incidence of 
patient harm events in IHS-operated acute-care hospitals, estimating the 
preventability of these events, and determining the factors contributing to these 
events. This is the first in the series to sample records from a full range of patient 
ages, from newborns to older adults. 


This study also extends our body of work related to quality of care in IHS hospitals. 
Two OIG reports issued in October 2016 found that IHS was limited in its ability to 
provide rigorous quality oversight and described challenges that affected IHS 
hospitals’ abilities to provide quality care and maintain compliance with Federal 
regulations.” An OIG report issued in July 2019 described challenges that IHS faced 
during the closure and reopening of one IHS hospital emergency department and 
continued problems maintaining compliance with Federal regulations.*' Finally, an 
OIG report issued in August 2019 found that a lack of organizational structure and 
clarity in understanding hospital performance hindered IHS’s ability to make 
improvements.” Prior congressional testimony and Government Accountability 
Office (GAO) reports have also raised concerns about the quality of care provided by 
IHS facilities.” 


Indian Health Service 


IHS is responsible for providing Federal health services to American Indians and 
Alaska Natives (AI/ANs), and in fiscal year (FY) 2020 Congress appropriated $6 billion 
for IHS.%4 IHS’s mission is “to raise the physical, mental, social, and spiritual health of 
AI/ANs to the highest level.”*° In partnership with Tribes, IHS provides health care 
services to approximately 2.6 million Al/ANS living in the United States who are 
members of the 574 federally recognized Tribes.“% IHS manages its health care 
services through 12 Area Offices, each providing support and oversight for the health 
care delivery sites located within a specified geographic region.” The delivery sites 
may include hospitals, health stations, and other types of facilities.” 


IHS provides health care services directly to AI/ANs through IHS-operated facilities or 
provides financial support for the Tribes to operate their own health care systems.” 
In FY 2020, about $2.3 billion of IHS's Federal appropriations was designated to run 
hospitals and health clinics.% Of that, about 40 percent was allocated directly to 
federally operated hospitals and clinics, and the remaining 60 percent was allocated 
to individual Tribes or Tribal organizations.*' IHS-operated facilities may also receive 
reimbursement from Medicare, Medicaid, and private insurance for services they 
provide to Al/ANs enrolled in these programs or health plans.** Annually, IHS collects 
approximately $1.2 billion from these three sources.” 


IHS Hospitals 


In FY 2017 (October 2016 through September 2017), IHS directly operated 
26 acute-care hospitals in 7 IHS Areas, mostly in remote locations. (As of July 2020, 
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there were 24 IHS hospitals.**) Five of the 26 IHS hospitals were designated by 
Centers for Medicare & Medicaid Services (CMS) as critical access hospitals, which 
receive cost-based Medicare reimbursement to provide essential services in rural 
communities.** 


IHS hospitals are typically small, with most having fewer than 30 beds and fewer than 
1,000 patient admissions annually. In FY 2017, there were a total of 17,210 inpatient 
admissions to IHS-operated hospitals, averaging out to 662 admissions per hospital.** 
The total average daily census was approximately 158 inpatients across all IHS 
hospitals, with an average daily census of approximately 6 inpatients per IHS hospital. 
Collectively, seven hospitals cared for more than three-quarters of the IHS 
inpatients.” See Exhibit 2 for a breakdown by IHS Area of the number of IHS 
hospitals, the number of inpatient admissions, and the average daily census. 


Exhibit 2: Patient Volume in IHS Hospitals by Area in FY 2017 

















IHS Area IHS-Operated Admissions Average Daily 
Hospitals (Range) Hospital Census* 

Albuquerque (NM) 4 5-454 1.2 
Bemidji (MN) 2 10-62 1.4 
Billings (MT) 3 6-644 2.3 
Great Plains (ND, SD, NE) 7 2-1,585 3.5 
Navajo (AZ, NM) 4 355-3,154 16.5 
Oklahoma (OK) 2 365-1,155 8.5 
Phoenix (AZ) 4 59-2,801 8.9 
Overall Average -- 662 6.0 


Source: OIG analysis of patients admitted to IHS hospitals in FY 2017. 
*Average daily census does not include newborns. 


In addition to providing acute-care services, IHS hospitals also admitted or delayed 
discharge for a small number of patients (203 patients) in FY 2017 for nonmedical or 
“social” reasons. For example, IHS has allowed patients to stay in the hospital longer 
than medically necessary because their homes were not suitable for recovery.** 

A prior OIG report found that IHS hospitals experienced challenges with discharge 
planning; staff cited the lack of post-acute care services (e.g., nursing homes, 
rehabilitation clinics) and difficult living conditions (e.g., no running water or 
electricity) experienced at home by some IHS patients.*° 


Scope of Services. Many IHS hospitals only offer a limited scope of services to 
patients, often resulting in patient transfers for specialized or more complex care. For 
example, some IHS hospitals do not have operating rooms; labor and delivery units; 
or imaging equipment such as computerized tomography (CT) scanners. In situations 
in which an IHS hospital is unable to provide a patient with medically necessary care, 
the patient is either transferred to another IHS facility or referred to a non-IHS 
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provider. Currently, IHS has only one Level Ill trauma center capable of providing 
trauma care to injured patients and improving survival outcomes.“ 


Staffing Shortages. IHS hospitals often have difficulty hiring and retaining qualified 
medical personnel, particularly in remote areas.** The Health Resources & Services 
Administration (HRSA), an agency tasked with improving health care to the medically 
vulnerable, has designated all IHS hospitals as facilities in areas with shortages of 
health care professionals.” In 2017, IHS reported agencywide vacancy rates of 

29 percent for physicians and 27 percent for nurses.** A OIG report found that 
vacancies had a significant impact on the continuity and quality of care provided at 
IHS hospitals. Hospital administrators reported that staffing shortages sometimes 
forced them to turn away patients and resulted in compliance issues with Federal 
requirements.“ One IHS hospital closed its emergency department in 2015 after 
numerous quality-of-care problems, largely because of staffing shortages.*’ In a 
review of this closure, OIG recommended that IHS leadership intensify efforts to 
develop and implement a staffing program for recruiting and retaining staff and 
leadership for these remote hospitals.”® 


Population Served. The Al/AN population faces persistent disparities in health 
outcomes. Because of these disparities, HRSA has designated AI/ANs as a medically 
underserved population.*? AI/ANs have a lower average life expectancy than other 
Americans (5.5 years less) and die at higher rates from many common conditions. 
AI/ANs are 3.2 times more likely to die from diabetes and 4.6 times more likely to die 
from chronic liver disease and cirrhosis.” These disparities are likely attributable to 
disproportionate poverty, inadequate access to health services, and other factors that 
leave the AI/AN population vulnerable to poorer health outcomes.*' 


The AI/AN population aged 65 and older has health problems (such as diabetes or a 
previously diagnosed heart attack) at higher rates and more frequently experience 
barriers to care than the overall U.S. population age 65 and older.** AI/ANs in this age 
group also report having more difficulties with activities of daily living, and such 
difficulties are often associated with greater health needs.” As with the general 
AI/AN population, these higher rates of poor health are likely attributable to 
socioeconomic disparities (e.g., household income, employment status, educational 
attainment, etc.).°* 


Comparison to Hospitals Nationwide. In addition to being federally operated, small, 
and rural, IHS hospitals have lower patient volume, provide less clinically complex care 
(as measured by hospitals’ case mix index), and have shorter average length of stays 
than acute-care hospitals nationally. Each of these three metrics indicates that IHS 
hospitals provide care to patients that is likely less intensive with fewer procedures 
and lower costs than the services provided in other hospitals. Exhibit 3 on the next 
page provides a summary of key differences between IHS hospitals and other 
acute-care hospitals participating in Medicare.*© 
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Exhibit 3: IHS hospitals provided less clinically complex and intensive care 
than other acute-care hospitals in FY 2017. 


All acute-care hospitals m IHS hospitals 


Average Daily Census 


Wi: 


Average Case Mix Index* 


SSS ow 


Average Length of Stay 


A <- 


Sources: IHS, "Fiscal Year 2017 Hospital Inpatient Statistics for IHS and Tribal Sites with Prior Fiscal Year Comparisons,” 
the Centers for Medicare & Medicaid Services, “Inpatient Prospective Payment System Impact File 2017,” and the 
Agency for Healthcare Research and Quality, “Overview of U.S. Hospital Stays in 2016: Variation by Geographic Region.” 
*A hospital's case mix index measures the clinical complexity of its patient population. A higher number corresponds to 
greater complexity. We excluded the five IHS critical access hospitals from our analysis because these hospitals do not 
participate in the Federal payment program which contains this data. 


110 








4.6 


HHS Agencies Involved in Patient Safety 


CMS and the Agency for Healthcare Research and Quality (AHRQ) are the key U.S. 
Department of Health and Human Services (HHS) agencies tasked with monitoring 
patient safety and health care quality across the United States, including in IHS 
hospitals. 


CMS. CMS is responsible for the regulation and oversight of care provided in 
hospitals that participate in Medicare and Medicaid.” Under its rulemaking authority, 
CMS has instituted payment policies to reduce adverse events.** CMS also manages 
multiple national-level initiatives designed to supplement hospital-based efforts to 
improve quality of care and patient safety such as Quality Improvement Organizations 
(QIOs) and the Partnership for Patients initiative. QlOs bring together beneficiaries, 
providers, and communities into Quality Innovation Networks (QINs) to share best 
practices for enhanced care.” The Partnership for Patients initiative is a 
public-private partnership working to “improve the quality, safety and affordability of 
healthcare for all Americans.”®' As part of this initiative, CMS awarded contracts to 

16 Hospital Improvement and Innovation Networks (HIINs) that work to make care 
safer and improve care transitions. HIINs provide training to improve patient safety, 
and track and monitor hospital progress.* 


AHRQ. AHRQ is tasked with improving the quality and safety of the health care 
system through research and implementation of evidence-based practices. AHRQ 
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has several initiatives to assist hospitals in monitoring and preventing adverse events. 
AHRQ developed common definitions and formats (known as the Common Formats) 
for hospitals and other organizations to report data on adverse events. AHRQ also 
manages the Patient Safety Organization (PSO) program. PSOs aggregate and 
analyze information (including details about adverse events) and conduct other 
patient safety activities, which include offering expert feedback and advice to 
hospitals, physicians, and other health care providers to reduce adverse events and 
improve patient safety.°” 


IHS Hospital Quality and Safety 


Medicare Conditions of Participation 


IHS instructs its hospitals to “meet the requirements of a nationally recognized 
accrediting or certifying body.”® Accrediting organizations used by IHS must support 
the reimbursement requirements established by CMS. Among these requirements 
are the Medicare Conditions of Participation, a set of minimum quality and safety 
standards. One of the Conditions of Participation requires hospitals to develop and 
maintain Quality Assessment and Performance Improvement (QAPI) programs.” As 
part of their QAPI programs, hospitals must “track medical errors and adverse patient 
events, analyze their causes, and implement preventive actions and mechanisms that 
include feedback and learning throughout the hospital.”” 


Hospital Incident Reporting Systems 


To meet the QAPI requirements, IHS operates an incident reporting system, called 
WebCident, to monitor adverse events and other patient safety issues.’* Physicians, 
nurses, and other hospital staff report patient safety-related events into WebCident. 
Patients and their family members may also report events. Reports typically include 
first-person accounts and other descriptive information about the events. In addition 
to logging events into WebCident, IHS hospitals may keep their own incident report 
files that capture similar information. Prior OIG work found that hospitals nationwide 
use incident reporting systems as the primary tool to track and analyze patient harm 
events.” 


Although IHS hospitals operate incident reporting systems, it is likely that not all 
adverse events are recorded in these systems. A GAO study found that IHS providers 
did not consistently use WebCident to report adverse events in 2017. IHS officials 
stated that the lack of reporting resulted in a lost opportunity to address deficiencies. 
Furthermore, OIG learned from interviews with IHS in December 2019 that the 
WebCident system is no longer supported and lacks the capability to categorize 
reports, query data, and send automatic notifications when a report is entered into 
the system.” 


Incidence of Adverse Events in Indian Health Service Hospitals 


OEI-06-17-00530 


Background | 7 


In December 2018, IHS awarded a contract for a new adverse event reporting and 
tracking system to replace WebCident.’® IHS recently transitioned event reporting 
from WebCident to the new system, IHS Safety Tracking 8l Response (I-STAR).” The 
new system has an improved interface and captures data from IHS-operated facilities, 
including clinical errors and adverse events. Unlike WebCident, |-STAR supports 
running queries to create reports, allowing for the compilation of aggregate data. 
Analysis of these data could enable IHS to better identify potential patterns and 
vulnerabilities. IHS has also conducted agencywide training for I-STAR.” As part of 
this transition, IHS is currently sunsetting WebCident and will retire the system after 
all reported events in this system are closed. 


Hospital Participation in Federal Improvement Efforts 


IHS hospitals participate in several improvement initiatives through Federal programs. 
In 2016, as part of the Partnership for Patients, CMS awarded several grants to 
QIN-QIOs and HIINs to support IHS QAPI programs.” ®° In 2017, CMS and IHS 
reported to OIG that IHS hospitals received support for QAPI programs through these 
initiatives.°" One example is the Partnership to Advance Tribal Health, a QIN-QIO 
initiative that supports best practices and other improvements at IHS hospitals.®* 


IHS also has several quality improvement initiatives underway as part of its Quality 
Framework, launched in November 2016.% IHS is in the early stages of implementing 
new policies and programs under its 2018 Quality Framework and 2019 Strategic 
Plan.** The Quality Framework’s initiatives include the National Accountability 
Dashboard for Quality to capture performance data to monitor and improve quality of 
care; a patient experience survey; and others.* In December 2018, IHS created an 
Office of Quality to “provide leadership and promote consistency in healthcare quality 
across the agency."* This office is responsible for developing and monitoring 
agencywide quality-of-care standards, which at the time of this study had not yet 
been fully developed.?” A new effort by this office is the Quality, Assurance, and Risk 
Management Program (QARM), which is developing new governance processes and 
oversight systems to review high-risk issues, clinical issues, business impact, and the 
financial integrity of IHS facilities. As OIG has recommended, in January 2020, IHS 
announced the development of a national compliance program to improve the care 
and treatment for the Al/AN population. 


IHS Hospitals in the Great Plains Area 


In recent years, inadequacies at IHS hospitals in the agency’s Great Plains Area have 
been an area of concern. In February 2016, the Senate Committee on Indian Affairs 
held a hearing on the substandard quality of care in IHS hospitals in the Great Plains 
Area. Testimony from CMS and Tribal representatives described quality-of-care 
concerns at several hospitals in the Area, including noncompliance with both the 
Medicare Conditions of Participation and the requirements of the Emergency Medical 
Treatment and Labor Act. Findings of noncompliance included deficiencies in critical 
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capabilities such as maintaining staff and equipment.” Subsequent hearings in 2017 
and 2018 raised similar concerns about IHS hospitals, with testimony covering the 
following issues: problems with access to care, hospital closures, and difficulty— 
particularly in the Great Plains Area—maintaining staffing.” 


During this timeframe, IHS hospitals in the Great Plains Area continued to struggle 
with Medicare compliance. CMS terminated one Great Plains Area hospital from the 
Medicare program in 2015 and another in 2017.” To avoid termination, another 
hospital completed a Systems Improvement Agreement—a corrective action contract 
that CMS may undertake with hospitals facing termination.” A fourth Great Plains 
Area hospital, which was at risk for termination, voluntarily stopped accepting 
inpatient admissions.” 


Measuring Patient Harm 


Researchers and health care entities may adopt different standards for distinguishing 
degrees of harm and defining what constitutes an adverse event. The National 
Coordinating Council for Medication Errors Reporting and Prevention (NCC MERP) 
Index classifies events by level of patient harm, including categories for circumstances 
that presented a risk but did not cause harm and those that did cause harm.” The 
NCC MERP Index was initially developed to categorize the effect of medication errors, 
but researchers have modified the Index to measure and distinguish other types of 
adverse events. For example, IHI uses a modified version of the NCC MERP Index to 
measure the degree of harm.” OIG has also used a modified NCC MERP Index for its 
adverse events work since 2008.7’ 


Related Work 


During the medical record review for this study, nurse-screeners and 
physician-reviewers identified instances where the care provided to several labor and 
delivery patients did not follow national clinical guidelines or best practices. In most 
of these instances, the care did not cause patient harm. A companion report, 
Instances of IHS Labor and Delivery Care Not Following National Clinical Guidelines or 
Best Practices (OEI-06-19-00190) describes these instances. 


Methodology 


Scope 


This report estimates the incidence rates of adverse events and temporary harm 
events experienced by patients in IHS hospitals in FY 2017. These incidence rates are 
representative of all patients who received acute-care services in IHS hospitals in 

FY 2017. The incidence rates are composed of all patient harm events, regardless of 
whether they were preventable. We do not provide a cost estimate for these events 
because we did not have admission-level cost data for IHS hospitals. We also do not 
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provide projections for characteristics, such as severity and preventability, for which 
we have too few sample events to make reliable projections. Instead, we present this 
information as numbers of events identified in our sample. 


Sample Selection and Profile 


Using encounter data from IHS’s National Data Warehouse, we selected a stratified, 
random sample of 400 patients from all patients admitted to one or more of the 
26 IHS-operated hospitals during FY 2017.8 We selected this sample from the 
general population of patients who had IHS hospital stays which included adults 
(aged 18 to 64), older adults (aged 65 and older), labor and delivery patients (any 
age), and pediatric patients (up to and including 17 years of age). See Exhibit 4 for 
the demographics of the study population. 


Exhibit 4: Demographics of the IHS Patient Population in FY 2017 







Labor and 
Delivery 
= 16% 


Pediatric 
24% 


Source: OIG analysis of encounter data for 14,949 patients admitted to IHS hospitals in FY 2017. 


We excluded 15 patients from our analysis because they did not have a conventional 
inpatient stay for acute-care services. Thirteen of these patients were admitted to a 
drug dependency unit, and the other two patients were admitted as research 
participants. We excluded an additional admission because the hospital was unable 
to locate the medical record for the patient. The final sample consisted of 

384 patients. 


We used a stratified sample design with six strata. IHS patients were placed into 
strata based on hospital location and size so that we could ensure that the sample 
included a range of small hospitals, that it did not overly burden larger hospitals with 
a high number of requests for medical records, and that we could make projections to 
the Great Plains Area.*? See Exhibit 5 on the next page for a description of the strata 
populations and sampled patients. 
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Exhibit 5: Patient Population and Sample Sizes by Stratum (Hospital Group) 


Stratum number Total patients Sample size* 
1 1,337 50 
2 552 40 
3 274 40 
4 349 70 
5 2,720 100 
6 9,717 100 


Source: OIG analysis of encounter data for 14,949 patients admitted to IHS hospitals in FY 2017. 
*Sixteen of the 400 selected patients were not included in the final analysis because they were either missing records 
or did not have a conventional inpatient stay for acute-care services. 


We reviewed all stays during the year for each sampled patient. Of the 384 patients 
in our sample, 48 had more than one stay at an IHS hospital during FY 2017 

(32 patients had 2 stays, and 16 had more than 2 stays). The IHS patients in our 
sample had a combined 457 hospital stays with discharges in FY 2017 and an average 
length of stay of 3.5 days. 


Data Collection 


We requested complete medical records for the sampled patients’ stays at IHS 
hospitals. We reviewed the medical records for completeness and made additional 
requests for any missing components. 


Identification of Adverse Events and Temporary Harm Events 


We conducted a two-stage review to identify adverse events and temporary harm 
events among sampled patients. (See Appendix A for a further description of our 
methodology for identifying events and determining preventability and see 
Appendix B for a glossary of selected clinical terms used to describe events.) 


Nurse Screening. The first stage was a screening process to identify patients who 
were likely to have experienced harm events during their stays. Three registered 
nurses used a trigger tool methodology (based on IHI’s GTT) to look for “triggers"— 
clinical clues—that indicated possible patient harm. The nurses looked for different 
triggers depending on patient type (e.g., older adults versus labor and delivery 
patients). If the nurses identified possible patient harm events during the IHS hospital 
stays, they flagged them for the second stage of review. The flagged records could 
include more than one possible harm event. Nurses flagged 57 patients’ records and 
also requested checks for an additional 24 in which they did not identify likely patient 
harm but found that the case included complexities that warranted additional review. 
In total, nurses flagged 81 of the 457 admissions in the sample for the second stage 
of review. 
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Physician Review. In the second stage of review, physicians reviewed admissions 
flagged by nurses as well as an additional 100 admissions for quality assurance. 
Physician-reviewers used the medical records, results from the nurse's review, and a 
summary of the encounter data from IHS’s National Data Warehouse to facilitate their 
reviews. They either confirmed or refuted the nurses’ findings and independently 
identified any additional patient harm events. For each event, the physician-reviewers 
followed a structured protocol that required them to describe the event, the relevant 
evidence in the medical record, the level of harm experienced by the patient, and 
whether the event was preventable. In total, physicians reviewed 181 admissions. 


Assessment of Preventability. The physician-reviewers determined whether events 
were preventable—i.e., those that could have been avoided if the patients had been 
given better care. They assigned each event to one of five preventability 
determinations—clearly preventable, likely preventable, likely not preventable, clearly 
not preventable, or unable to determine. They selected a rationale for each 
preventability determination from a list of 25 contributing factors based on prior 
research and experience in OIG studies of adverse events. This list includes factors 
that contribute to preventable events, such as medical error or inadequate 
monitoring, and factors that contribute to nonpreventable events, such as whether a 
patient was particularly susceptible to an event because of the patient's health status. 
See Appendix A for further explanation about assessing preventability. 


Assessment of Severity. As in prior OIG studies, physician-reviewers assigned each 
event to one of five harm levels using a modified version of the NCC MERP Index for 
Categorizing Medication Errors. We distinguish between “adverse events” (levels F 
through | on the index) and “temporary harm events” (level E on the index) to 
separately identify events that were more likely to affect costs to Medicare and a 
patient's length of stay. In addition, we sometimes use the term “patient harm 
events” to refer collectively to both adverse events and temporary harm events, as 
both types of events represent harm resulting from medical care. (See Exhibit 6.) 


Exhibit 6: OIG-Modified Version of the NCC MERP Index for Categorizing Events 


Event Type 


Level Description 





Adverse Event 


Harm occurred that may have contributed to or resulted in the patient's 
death. 





H | Harm occurred that required intervention to sustain the patient's life. 





G | Harm occurred that contributed to or resulted in permanent patient harm. 





Harm occurred that contributed to or resulted in prolonged facility stay, 
elevation in level of care, or transfer to another facility. 





Temporary 
Harm Event 


E | Harm occurred that caused temporary harm that required intervention. 











Source: Adapted from the NCC MERP Index for Categorizing Errors. Revised February 20, 2001. 
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Data Analysis 


We analyzed the results of the physicians' reviews and generated national estimates 
of the incidence rates of patient harm events in IHS hospitals. We also compared 
incidence rates for IHS hospitals in the Great Plains Area to those of IHS hospitals in 
all other IHS Areas, and those of small IHS hospitals to those of large IHS hospitals. 
However, as explained above, we were unable to reliably project estimates for 
Characteristics of events, such as preventability classification, harm level, and event 
category, because the sample size was insufficient. Instead, we used sample numbers 
to describe the characteristics of events. (See Appendix D for point estimates, 
95-percent confidence intervals, and key statistics and Appendix E for sample counts.) 


Incidence Analysis. We estimated the incidence rates within the population from 
which we selected the sample (patients admitted to IHS hospitals during FY 2017), 
and we provided the percentage of patients who experienced at least one harm event. 
We estimated the incidence rates for both adverse events and temporary harm 
events. 


As an additional measure, we estimated two ratios of incidence density commonly 
used by hospitals and medical researchers: events per 1,000 patient days and events 
per 100 hospital admissions. These metrics allow for a clearer comparison of samples 
with different lengths of stay and when some patients experience multiple events, 
making harm measurements more comparable across patient types and facilities. 
(See Appendix F for further explanation of incidence density estimations.) 


Analysis of Hospital Size and Location. We analyzed the events to identify 
differences by hospital size and location. For the hospital size analysis, we 
categorized the hospitals into 2 groups: smaller hospitals (those with fewer than 
1,000 admissions in FY 2017) and larger hospitals (those with 1,000 or more 
admissions in FY 2017). Most IHS hospitals—20 of the 26 IHS hospitals operating at 
the time of our study—were considered smaller hospitals, and 6 were considered 
larger hospitals. IHS hospitals in strata 1 and 6 were comprised of larger hospitals; 
the remaining strata were comprised of smaller hospitals. For the location analysis, 
we compared patients in hospitals located in the Great Plains Area to patients in 
hospitals located outside the Great Plains Area. 


Analysis of Clinical Category and Patient Type. We analyzed the events by clinical 
category and patient type. For clinical category, physician-reviewers divided events 
into four categories: medication, patient care, infection, and procedures. For patient 
type, we classified patients into four groups: adults (aged 18 to 64), older adults (aged 
65 and older), labor and delivery patients (regardless of age), and pediatric patients 
(those up to and including 17 years of age). We made this distinction because the 
type of care provided to patients differs depending on patient age and reason for 
admission (e.g., labor and delivery). 


Preventability Analysis. We estimated the incidence of preventable patient harm 
events and provide the percentage of patients within the population who had at least 
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one preventable event. Similarly, the incidence of nonpreventable patient harm 
events is the percentage of patients within the population who had at least one 
nonpreventable event (but no preventable events). We also present the number of 
preventable events and the number of nonpreventable events we found in the 
sample. (See Appendix E for the sample counts.) 


Limitations 


These results, as with all medical record reviews, are subject to physician 
interpretation and clinical judgment. Additionally, medical record reviews are 
dependent on available documentation; any information that was omitted could lead 
reviewers to miss some events or to make a different assessment as to whether an 
event was preventable. Therefore, it is unlikely that the reviewers identified all 
adverse events and temporary harm events within our sample of patients at IHS 
hospitals. 


In addition, we counted only patient harm events that occurred during the inpatient 
stays or a contiguous emergency department or other outpatient department visit. 
We did not include harm events that occurred in other health care settings preceding 
or following the patients’ arrival at the hospital (i.e., present-on-admission events). 


We also note that the GTT screening methodology used in the first stage of the 
review is not a comprehensive medical record review. Screeners may have missed 
some events because their review focused on a specific set of triggers. Analysis in a 
prior OIG study found that compared to a comprehensive medical record review by 
physicians, nurses using the GTT screening methodology identified 93 percent of 
patients with events. 10 


Finally, we were unable to project event-level characteristics and instead present 
relevant findings in terms of sample numbers. We also cannot compare most of the 
results of this study with those of other studies on adverse events because of the 
differences in population and settings. We included a descriptive comparison in one 
case: results for IHS patients 65 and over as compared to our results for Medicare 
patients in acute-care hospitals nationally and other settings, given their similar age 
and conditions. We were unable to make a statistical comparison of those results. 


Standards 


We conducted this study in accordance with the Quality Standards for Inspection and 
Evaluation issued by the Council of the Inspectors General on Integrity and Efficiency. 
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FINDINGS 





An estimated 13 percent of patients experienced adverse events 
or temporary harm events during their stays in IHS hospitals 


Of the nearly 15,000 patients admitted to IHS hospitals in FY 2017, an estimated 

13 percent (about 1 in 8) experienced at least 1 patient harm event during their stays. 
This projects to 1,840 patients experiencing harm as a result of medical care received 
in IHS hospitals during this period. Patients who experienced patient harm events fell 
into two categories: 


> 4 percent of patients experienced adverse events (harm events that resulted in 
a prolonged hospital stay, permanent patient harm, life-sustaining 
intervention, or contributed to death), and an additional 


> 8 percent of patients experienced temporary harm events (harm events that 
required medical intervention but did not lead to a prolonged hospital stay or 
cause lasting harm).* 


Harm rates may be affected in part by patient type, the complexity of care provided, 
and patients’ length of stay. Prior OIG work on patient harm has focused on Medicare 
patients, who are older than the general population and require more complex 
care.'°' A prior OIG study of adverse events among hospitalized Medicare patients 
found that 27 percent of Medicare beneficiaries experienced harm. Given the 
differences in populations and samples, we determined that it would not be valid to 
compare rates across studies. Research from outside OIG has estimated harm rates 
ranging from 9 to 33 percent for adult and pediatric patients at non-IHS hospitals. '° 
See Appendix F for information about limitations to comparing rates of patient harm 
events in IHS hospitals to those in other health care settings. 


The incidence rate of patient harm in IHS's Great Plains Area 
was similar to that of other IHS Areas 


The rate of patient harm events in hospitals IHS's Great Plains Area was not 
significantly different from the rate of patient harm in the remainder of IHS hospitals. 
As previously discussed, IHS hospitals in the Great Plains Area are of concern because 
of past quality and safety issues. Fourteen percent of patients in the Great Plains Area 
experienced at least one adverse or temporary harm event, and 12 percent of patients 
outside of the Great Plains Area experienced a harm event; this difference was not 
statistically significant (see Exhibit 7 on the next page).'” 


a The combined total of patients who experienced adverse events (4 percent) and temporary harm events 
(8 percent) does not total 13 percent because of rounding. 
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Exhibit 7: Patients in IHS's Great Plains Area had rates of adverse events and temporary 
harm events that were similar to those for patients in other IHS hospitals (n=384). 


IHS hospitals in 
Great Plains Area 


Adverse events and temporary harm events 14% 


Temporary harm events 12% 


Adverse events 3% 


Adverse events and temporary harm events 12% 


IHS hospitals outside 
Great Plains Area Temporary harm events 7% 


Adverse events 5% 


Source: OIG analysis of 384 IHS patients admitted to IHS hospitals in FY 2017. 

Notes: We found no statistically significant difference in the rate for hospitals in IHS’s Great Plains Area and the rate all other IHS hospitals 
(p=.5422). In addition, the rates of temporary harm events and adverse events for IHS hospitals in the Great Plains Area do not total the rate 
of the two types combined because of rounding. 


Patients in smaller IHS hospitals were more likely to experience 
adverse events and temporary harm events than patients in 
larger IHS hospitals 


The rate of patient harm among smaller IHS hospitals (hospitals with fewer than 

1,000 admissions in FY 2017) was higher than the rate we observed in larger hospitals. 
Nineteen percent of patients in smaller hospitals experienced patient harm events, 
compared to 9 percent of patients in larger hospitals (see Exhibit 8 on the next 
page).'“ A prior OIG report found that providers in some IHS hospitals struggle to 
maintain clinical competence as a result of low patient censuses and limited scopes of 
services, with providers having less opportunity to exercise their skillsets.*% Although 
the prior work did not distinguish between smaller and larger IHS hospitals, this issue 
may be compounded in smaller IHS hospitals, particularly those in remote locations. 
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Exhibit 8: Patients in smaller IHS hospitals were more likely to experience an adverse or 


temporary har 


m event than patients in larger IHS hospitals (n=383*). 





Smaller IHS 
Hospitals 


rN 


A 


Larger IHS 1 
Hospitals 


Adverse events and temporary harm events 


Temporary harm events 14% 





dverse events 5% 





dverse events and temporary harm events [ELA 


emporary harm events PEF 


Adverse events 4% 


Source: OIG analysis o 


f 384 IHS patients admitted to IHS hospitals in FY 2017. 


19% 


*For one patient with two hospitalizations during the year, one admission was ineligible for this particular analysis because the patient did not 
receive acute-care services. As a result, the n here is 383 rather than 384 patients. 
Note: We found a statistically significant difference in the rate of adverse and temporary harm events between smaller IHS hospitals and 


larger IHS hospitals (p 


Exhibit 9: Mos 


=.0094). 


Most of the 79 patient harm events in our sample were 


temporary harm events 


Physician-reviewers identified a total of 79 patient harm events; 19 of these events 


were adverse events, resulting in prolonged hospital stays and other serious 
consequences, and 60 were temporary harm events that required medical 


intervention but did not cause lasting harm. Sixty-one of the 384 patients in our 
sample experienced harm, with a small number of sampled patients (11 of the 

61 patients) experiencing multiple unrelated harm events during their stays. (See 
Exhibit 9 for the number of adverse events and temporary harm events identified in 


our sample by harm level.) 


t events were classified as temporary harm (n=79 events). 








Number of 
Event Type Level of Harm 

Events 
F level: Resulted in prolonged hospital stay, an elevation in the 13 

level of care, or resulted in transfer to another facility 
Adverse Eent G level: Contributed to or resulted in permanent patient harm 1 
H level: Required intervention to sustain the patient's life 4 
| level: Contributed to or resulted in patient death 1 
Temporary Harm Events E level: Resulted in temporary harm and required intervention 60 
Total All levels of harm 79 


Source: OIG analysis of 





384 patients admitted to IHS hospitals in FY 2017. 
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More than half of the patient harm events in our sample related 
to the use of medication 


We found that—as in previous OIG studies of patient harm—medications and patient 
care led to the highest numbers of harm events. Medication-related events were the 
most common patient harm events in our sample (41 of 79 events). Patients who 
experienced these events often suffered from oversedation, confusion, and 
hallucinations. Medication-related events also included hypoglycemic episodes in 
patients with diabetes and problems with blood pressure management (e.g., 
hypotension while on medication). 


Patient care events were the next most common type of harm event in our sample 
(29 of 79 events). This category pertains to the daily care of patients, which is often 
performed by nurses. Patient care events commonly involved intravenous catheter 
infiltration (leaking of fluid or medication into surrounding tissue) that resulted in 
burns, swelling, and pain (nine events). Other patient care events involved 
postpartum hemorrhage; pressure injuries; and skin tears, abrasions, and breakdowns. 


Six events in our sample related to infections or procedures. Two of the six infections 
involved serious surgical site wounds, with one leading to permanent harm and the 
other necessitating life-saving intervention. Only three events in our sample related 
to medical procedures, possibly because IHS hospitals perform few surgeries. 

(As previously noted, some IHS hospitals lack operating rooms, so patients requiring 
surgical intervention are transferred to other locations.) Procedure-related events 
included a postoperative atrial fibrillation (irregular heartbeat) and a 
procedure-related laceration during labor and delivery. See Exhibit 10 (on the next 
page) for the list of events identified within each of the four clinical categories 
(medication, patient care, infections, and procedures). 


Incidence of Adverse Events in Indian Health Service Hospitals 


OEI-06-17-00530 


Findings | 18 


Exhibit 10: More than half of the patient harm events in our sample related to the use 
of medication (n=79 events). 


Adverse Events and Temporary Harm Events by Clinical Category Number of Events 
Medication 41 
Delirium or other change in mental status 1 
Hypoglycemia (low blood sugar) 

Hypotension/hypertension (low blood pressure/high blood pressure) 

Allergic reaction to medication 

Diarrhea while on medication 

Tachysystole (excessive uterine contractions) and related conditions 

Nausea and vomiting 

Cardiac arrhythmia 

Excessive bleeding while on multiple blood thinners 

Interstitial nephritis (inflammation of the kidney) 


Prolonged constipation while on opioids 


2 22220 N04Y04uwQwOo yn 


Seizure leading to fall and head injury 


N 
w 


Patient Care 

Infiltration, burn, or vein inflammation from intravenous catheter 
Postpartum hemorrhage 

Pressure injury 

Skin tear, abrasion, or breakdown 
Fluid/electrolyte disorders 

Hypotension 

Allergic reaction 

Diabetic ketoacidosis 

Exacerbation of abnormal liver condition 
Fall that led to contamination and infection 
Life-threatening oxygen desaturation 


Severe hypertension/preeclampsia 


ewe = 2 2 2 2 wo Nu WwW KR © 


Infections 


Soft tissue or other nonsurgical infections 


N A 


Surgical site infections 


Procedures 
Atrial fibrillation 


Procedure-related laceration 


— e e 


Urinary retention 





Source: OIG analysis of 384 IHS patients admitted to IHS hospitals in FY 2017. 
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Older adults and labor and delivery patients in our sample 
experienced higher proportions of harm events; pediatric 
patients had fewer harm events 


Proportionally, we found more harm events among older adults (aged 65 and older) 
and labor and delivery patients in our sample, and fewer events among pediatric 
patients (17 and younger). Given the small number of events, we were unable to 
project the rates of adverse events and temporary harm events for subgroups of 
patients determined by age or patient type. Adults ages 18 to 64 who were not labor 
and delivery patients appeared to have a similar proportion of harm (15 percent) as 
the overall incidence rate (13 percent). See Exhibit 11 for the number and unweighted 
percentage of patients who had adverse events and temporary harm events within the 
three subgroups. 


Exhibit 11: Older adults and labor and delivery patients experienced more 
adverse events and temporary harm events than other patients in our 
sample (n=384). 


Patient type Percentage with harm events 


18 of 61 30% 
10 of 48 21% 


5% 


Older adults 
Labor and delivery 


Pediatric 





Source: OIG analysis of 384 IHS patients admitted to IHS hospitals in FY 2017. 
Note: These percentages are unweighted and not projectable to all IHS patients in these groups. 


Thirty percent of older adults (aged 65 and older) in our sample 
experienced an adverse event or temporary harm event 


In our sample, we found that 18 of 61 older adults (30 percent) experienced an 
adverse event or temporary harm event during their stays in IHS hospitals. As 
previously mentioned, our prior study of adverse events among Medicare 
beneficiaries, typically age 65 and older, found that 27 percent experienced adverse 
events or temporary harm events. 1% 


Older adults often experienced more than a single patient harm event, with a total of 
29 adverse events and temporary harm events experienced by these 18 patients. 

As with the broader sample of patients, harm events among older adults were most 
commonly related to medications (15 of 29 events) and patient care (9 of 29 events). 
Many of the medication-related events related to delirium or other changes in mental 
status (8 events) with most of these events involving the administration of opioids 
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leading to confusion and hallucinations. Patient care events included issues such as 
pressure injuries (three events) and problems with intravenous catheters (two events). 


One factor that may have contributed to the higher proportion of harm events among 
older adults in our sample is the length of their hospital stays. The average length of 
stay for older adults in our sample was 4.8 days, compared to 3.5 days for sampled 
patients overall. 


il Patient Story 1 





An older adult patient with multiple medical problems and a history of heart failure 
was admitted to the hospital for severe leg swelling and cellulitis (skin inflammation). 
During the hospital stay, the patient was given excessive medication for cramps and 
insomnia (a total of 3 doses of 2 different benzodiazepines over 12 hours). The 
patient woke during the night confused (a known side effect of the medication) and 
fell out of bed. A nurse found the patient confused and on the floor minutes later. 
The attending physician later evaluated the patient and discontinued the medication. 


About one-fifth of labor and delivery patients in our sample 
experienced adverse events or temporary harm events 


We found that 10 of 48 labor and delivery patients in our sample (21 percent) 
experienced at least one adverse event or temporary harm event. Two of these 
patients experienced 2 harm events each, resulting in a total of 12 events experienced 
by labor and delivery patients. 


Four patients experienced postpartum hemorrhage that resulted in temporary harm. 
As described in the companion report about instances of care not meeting national 
clinical guidelines or best practices for labor and delivery, we found that postpartum 
hemorrhage was unusually common in our sample—experienced by one-third of 
labor and delivery patients (16 of 48).'°” For reference, research suggests that 1 to 

3 percent of labor and delivery patients nationwide experience postpartum 
hemorrhage.'® For two of the four patients who experienced a postpartum 
hemorrhage, our physician-reviewer determined the care (or lack of care) provided 
may have exacerbated the hemorrhage and resulted in excessive blood loss. The two 
other patients who experienced postpartum hemorrhage both had clinical 
complications (preeclampsia) that required their labor to be induced. Postpartum 
hemorrhage is a known risk factor associated with induced labor; therefore, our review 
determined that appropriate care was provided, and these two events were not 
preventable.’ The other 12 hemorrhages did not result in harm to the mother or 
newborn. 


Among the other eight harm events involving labor and delivery patients were three 
patients with tachysystole (excessive uterine contractions) as a result of medications 
used to induce labor (oxytocin or misoprostol) and two patients with hypotension 
(dangerously low blood pressure) as a result of epidural anesthesia (for pain relief). 
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H Patient Story 2 





A woman, admitted for labor and delivery, was induced using oxytocin. After 
induction, the patient experienced adequate uterine activity for a progression of 
labor, but staff did not appear to recognize this and unnecessarily increased the 
dosage of oxytocin which resulted in tachysystole (excessive uterine contractions). 
The increase in induction medication was not consistent with clinical guidelines and 
could have resulted in additional harm to the uterus or the newborn. 


Relatively few (4 of 81) pediatric patients in our sample 
experienced adverse events and temporary harm events 


We found that a small proportion (5 percent) of pediatric patients in our sample 
experienced an adverse or temporary harm event. This 5 percent was composed of 
four sampled patients. Three of the four patients had harm events that were related 
to patient care, and the fourth had an event related to medication. None of these 
patients had more than one harm event. The average length of stay for sampled 
pediatric patients was 2.2 days. 


A Patient Story 3 





A child was admitted for chronic respiratory disease and required supplemental 
oxygen. The attending physician prescribed a corticosteroid (anti-inflammatory 
medication) for treatment of the child's respiratory symptoms. The staff gave the child 
more than five times the prescribed dose of the medication (125 mg instead of 20 mg). 
The child developed diarrhea, which was caused by the higher than appropriate dose. 
After discovering the error, staff contacted poison control and provided supportive 
care for the overdose. 


Most patient harm events in our sample occurred within smaller 
hospitals or involved older adults or labor and delivery patients 


Hospital size and patient type may be characteristics of interest when assessing 
patient harm. As mentioned above, patients who received care in smaller hospitals 
were more likely to experience patient harm, with 54 of the 79 events occurring in 
smaller hospitals. Older adults within our sample experienced more harm events per 
capita than any other patient type, with a total of 29 events. Although the sample 
included fewer labor and delivery patients, this group also experienced a high number 
of harm events per capita, with a total of 12 events. Given that patients could belong 
to more than one of these subgroups (e.g., older patients could be treated in smaller 
hospitals), these characteristics were present in 68 of the 79 patient harm events 
identified. 
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An estimated 7 percent of patients experienced adverse events 
or temporary harm events that could have been prevented if 
patients had been given better care 


An estimated 7 percent of patients overall —nearly half of the 13 percent of patients 
who experienced harm events—experienced events that were preventable. Across all 
patient harm events, physicians determined that about half of the events in our 
sample (38 of 79) were preventable, ¡.e., they could have been avoided if patients had 
received better care. The other half of events (40 of 79) were determined to have 
been nonpreventable. Most of the more serious adverse events in our IHS sample 
were preventable (15 of 19 adverse events), whereas less than half of temporary harm 
events were considered preventable (23 of 60 events). Exhibit 12 below shows the 
number of events assigned to each preventability classification. (Our sample size was 
insufficient to project these estimates; see Appendix E for more information.) 


Exhibit 12: About half of the patient harm events identified in our sample 
were considered preventable (n=79). 








Preventability assessment Events within the sample 
Preventable — Harm could have been avoided through improved 38 (48%) 
assessment or alternative actions A 
Likely preventable 29 
Clearly preventable 9 
Not preventable — Harm could not have been avoided given the complexity 
cts ce . 40 (51%) 
of the patient's condition or care required 
Likely not preventable 34 
Clearly not preventable 6 
Unable to determine preventability 1 (1%) 





Source: OIG analysis of medical records for 384 patients admitted to IHS hospitals in FY 2017. 
Note: These percentages are unweighted and not projectable to all events. 


Preventable events in our sample involved substandard 
treatment, medical errors, and lack of monitoring 


Half of the preventable events in our sample (19 of 38) were the result of substandard 
treatment—i.e., the failure to adhere to national clinical guidelines and current best 
practices when delivering care. Other common factors that contributed to 
preventable events included medical errors, lack of adequate monitoring, and failure 
by clinicians to provide necessary treatment. These contributing factors are not 
necessarily mutually exclusive, and our physicians-reviewers often identified multiple 
factors as having contributed to preventable events. Exhibit 13 on the next page 
shows the most common factors that contributed to preventable events. 
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Exhibit 13: Substandard treatment contributed to half of preventable adverse events and 
temporary harm events in our sample (n=38). 


Contributing Factor Percentage of preventable events* 


19 of 38 50% 


Substandard treatment or therapeutic care 


Error in medical judgment, skill, or patient management 37% 
Patient's progress was not adequately monitored 18% 
Clinicians failed to provide necessary treatment 18% 
Substandard or inadequate preventive care 16% 





Source: OIG analysis of 384 patients admitted to IHS hospitals in FY 2017. 
*Reviewers often selected more than one rationale per event. 
Note: These percentages are unweighted and not projectable to all preventable events. 


Substandard treatment contributed to 19 events in our sample. These include 
delirium or other changes in mental status from oversedation; tachysystole from 
unnecessarily high doses of medication (misoprostol) used to induce labor; and failure 
to properly treat infections. For example, in one event, the overly aggressive use of 
antihypertensive blood pressure medication led to hypotension and kidney injury. In 
another event, a subtherapeutic dose of an antiepileptic medication contributed to a 
seizure leading to a fall with injury while the patient was left unattended. 


Patient Story 4 





One preventable event involved a delay in diagnosis and treatment of symptomatic 
hypercalcemia (high calcium levels), a condition that is often painful and can be 
quickly treated with saline. The patient, who was ultimately diagnosed with a blood 
cell cancer, was admitted for abdominal pain and had significant hypercalcemia, 
unexplained anemia, and kidney failure. Providers at the hospital failed to diagnose 
the hypercalcemia and did not recognize the symptoms of the cancer despite a classic 
presentation of the disease. They transferred the patient to a non-IHS hospital for 
imaging related to the abdominal pain 2 days after admission. Staff at the second 
hospital correctly identified the hypercalcemia and diagnosed the patient with a blood 
cell cancer. The physician-reviewers determined that the missed diagnosis of 
hypercalcemia was clearly preventable given the information available. The reviewers 
categorized the reasons for this harm as both substandard care and error in clinical 
judgment. 
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Nonpreventable events in our sample often involved patients 
who were in poor health and therefore highly susceptible to 
harm events 


Almost half of the nonpreventable harm events in our sample (19 of 

40 nonpreventable events) occurred because the patients’ poor health status left 
them susceptible to harm events. The other two most frequently cited factors used to 
classify events as nonpreventable were that the event occurred despite proper 
assessment and that the procedures being followed; and the provider could not have 
anticipated the event with information available at the time. See Exhibit 14 for the 
most common factors related to nonpreventable harm events. 


Exhibit 14: Nonpreventable events in our sample often related to patient susceptibility due 
to poor health (n=40). 





Percentage of nonpreventable 
events* 


19 of 40 48% 


38% 


Contributing Factor 







Patient was highly susceptible to event because of poor health 


Event occurred despite proper assessment and procedures followed 
Provider could not have anticipated event with information available at the time 33% 


Patient's diagnosis was unusual or complex, making care difficult 


Source: OIG analysis of 384 patients admitted to IHS hospitals in FY 2017. 
*Reviewers often selected more than one rationale per event. 
Note: These percentages are unweighted and not projectable to all preventable events. 


Patient susceptibility due to poor health often included older adults with multiple 
comorbidities (13 of 19 nonpreventable events). These nonpreventable events 
involved delirium due to medication following major surgeries and procedures; 
hypotension while on medication to treat pre-existing health issues (e.g., congestive 
heart failure); pressure injuries due to immobility with those having a terminal 
condition; and skin tears or breakdowns among those with frequent stools. 


fl Patient Story 5 


One nonpreventable event involved an adult patient with liver cancer who was 
transferred to an IHS hospital for care. The patient had a history of diabetes, required 
a clear liquid diet, and was hypermetabolic (experiencing an increased rate of 
metabolic activity) which reduced the patient's insulin production. Less than a day 
after the transfer, the patient received their regular dose of insulin and then 
experienced a life-threatening hypoglycemic event. The physician-reviewers 
determined that the hypoglycemic event was likely not preventable because the 
patient's liver cancer and associated weight loss may have impacted their ability to 
process insulin and glucose. 
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RECOMMENDATIONS 





The rates of patient harm and preventable events confirm that IHS hospitals have 
both the need and opportunity to improve patient care and safety. An estimated 

13 percent of hospitalized IHS patients experienced adverse events or temporary 
harm events during their stays in FY 2017, with patients in smaller IHS hospitals more 
likely to experience patient harm than those in larger IHS hospitals. In our sample, we 
identified proportionally more harm among older adults (age 65 and older) and labor 
and delivery patients than among pediatric or young adult patients. Our 
physician-reviewers determined that half of the patient harm events in our sample 
were preventable—i.e., they could have been avoided if the patients had been given 
better care. 


IHS has ongoing and new initiatives designed to improve its quality of care. Recent 
efforts have included creating an Office of Quality and a Quality Framework to guide 
the organization's improvement activities. 


We recommend that IHS: 


Establish patient harm monitoring and reduction as a key 
priority of the Office of Quality 


As mentioned previously, IHS created an Office of Quality in late 2018 to guide the 
organization's improvement efforts. IHS is also in the early stages of implementing 
new policies and programs under its 2018 Quality Framework and 2019 Strategic Plan. 
However, it is unclear how it will incorporate patient safety into these efforts. IHS 
should ensure that patient safety, including identification of patient harm events, is a 
key priority of the new Office of Quality. As part of this role, the Office of Quality 
should monitor patient harm events in IHS's incident reporting system to identify 
opportunities for training and quality improvement efforts. The Office's identification 
of harm events could help hospital administrators and providers set goals for 
improvement, direct resources, and assess the effectiveness of prevention strategies. 


As part of its focus on patient safety, the Office of Quality should also produce 
educational correspondence or materials for hospitals and Area Offices that include a 
definition of “adverse event”; a list of potential patient harm events to educate staff 
on the range of harm patients can experience; evidence-based best practices for 
reducing harm in IHS hospitals; and best practices for improving staff identification 
and tracking of adverse events. The Office of Quality should also support Area Offices 
and hospital leadership in actively disseminating this information to IHS hospital 
providers to ensure widespread implementation of harm detection and safety 
practices. 
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Effectively track and monitor patient harm events using an 
improved incident reporting system 


Prior OIG work found that hospitals nationwide use incident reporting systems as the 
primary tool to track and analyze patient harm events. IHS has invested in a new 
incident reporting system that has the potential to advance hospitals” abilities to use 
patient harm events to identify opportunities for improvement. In announcing the 
system in 2018, IHS outlined a number of goals for the system, including improving 
management of incidents and ease of use. A December 2019 OIG report 
recommended that IHS ensure that the new reporting system is effective and allows 
staff to query and aggregate incident data. ''° 


Although the rollout of the new incident reporting system was delayed, IHS 
transitioned to its new system, I-STAR, in August 2020. Depending on the quality and 
the extent of its use, IHS's new incident reporting system could enable IHS to 
effectively monitor harm events, facilitate learning from these harm events, and 
identify areas for improvement efforts. To ensure I-STAR allows IHS to effectively 
track and monitor patient harm events, IHS should continue to develop and institute 
policies and agencywide training for this new system. 


Implement quality improvement plans to improve patient safety 
across IHS, including plans that focus specifically on smaller 
hospitals and patient groups at higher risk of harm 


IHS should design and implement quality improvement plans to improve patient 
safety and reduce the incidence of adverse and temporary harm events across IHS. 
This will require IHS to identify and address patient safety disparities for patient 
populations that may be at greater risk of harm. 


Our analysis found that patients in smaller hospitals were more likely to experience 
harm events than those in larger hospitals. We also found that older adults and labor 
and delivery patients experienced proportionately more harm events than other 
patient groups. In addition to focusing on the subset of hospitals and patient groups 
that we identified through our analysis for this report, IHS should work on an ongoing 
basis to identify facilities and patient groups at greater risk. This effort should be 
evidence-based, with the goal of improving patient outcomes. 


IHS's efforts to focus quality improvement plans on these hospitals and patient 
groups should include provisions unique to these specific challenges For example, a 
quality improvement plan for smaller hospitals could address maintaining clinical 
competence in the absence of a high volume of cases; a plan for older adults could 
focus on common comorbidities such as diabetes and heart conditions; and a plan for 
labor and delivery patients could include implementation of recommendations in our 
companion report, such as use of best practices in diagnosing and treating 
postpartum hemorrhage. 
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AGENCY COMMENTS AND OIG RESPONSE 





IHS concurred with our recommendations and affirmed that patient safety is a high 
priority for the agency. IHS described actions it has taken to improve patient safety 
since 2017, including efforts toward implementing the recommendations. OIG values 
the steps that IHS has taken and will monitor progress in implementing these 
recommendations as IHS continues its efforts to improve patient safety. (For the full 
text of IHS’s comments, see Appendix G.) 


In response to our first recommendation that IHS establish patient harm monitoring 
and reduction as a key priority of the Office of Quality, IHS reported that it has 
partnered with several HHS agencies, including AHRQ, CMS, and the Centers for 
Disease Control and Prevention (CDC), in its efforts to improve patient safety. For 
example, IHS and CMS established all-cause harm reduction as a priority of the 
Partnership to Advance Tribal Health—an initiative that supports best practices and 
improvements at IHS hospitals. This prioritization is an important first step. As IHS 
further develops new safety initiatives, it should monitor results and ensure that the 
Office of Quality has clear responsibility for monitoring harm and taking action, and 
that its efforts result in reducing harm. 


Regarding staff education efforts, the Office of Quality manages a web-based Quality 
Portal to support information sharing among IHS hospital and health center staff and 
leadership. IHS reported it is also implementing trainings such as AHRQ's Team 
STEPPS program—a teamwork system designed to improve patient safety— and has 
conducted trainings with the CDC and the American Hospital Association to improve 
infection control practices at IHS facilities. Regarding medication safety, IHS 
established a program to provide clinicians with knowledge, tools, and resources to 
reduce the risks associated with medications, and for risks related to opioids IHS 
recruited Area Office mentors to improve appropriate use of Naloxone (a medication 
used to treat opioid overdoses). In addition to these efforts, the Office of Quality 
should continue to identify areas for educational outreach to hospitals and health 
clinics, and develop trainings and materials to address these areas. The educational 
materials should directly address harm identification and best practices for identifying 
and reducing harm. 


In response to our second recommendation that IHS effectively track and monitor 
patient harm events using an improved incident reporting system, IHS reported that it 
has fully implemented its new incident reporting system, I-STAR, across all IHS Areas 
and facilities. IHS reported that the Office of Quality monitors reporting from the 
I-STAR system to identify adverse events and to address challenges in entering 
information into the system, and works with IHS Area Offices and facility staff to 
optimize I-STAR, provide training, and improve reporting. As IHS gains experience 
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using its new I-STAR system, we will look to IHS for evidence that it is effectively using 
this system to track and monitor patient harm events. 


In response to our third recommendation that IHS implement quality improvement 
plans to improve patient safety, IHS stated that its hospitals complete QAPI plans in 
accordance with CMS regulations and accreditation standards, and confirmed that 
these plans target patient safety and adverse events. It further stated that surveys of 
IHS hospitals and health centers have found full compliance with these standards. In 
2020, IHS established a national compliance program as a component of the IHS 
Enterprise Risk Management Program. The program's activities included oversight 
reviews of high-risk subject areas for all IHS Area Offices. This included reviews of IHS 
hospital Governing Board minutes to ensure that patient safety performance 
improvement measures were included in QAPI plans, and that when a suspected or 
potential patient safety event occurs, QAP! plans are reviewed to ensure performance 
improvement measures are incorporated in IHS hospitals. As IHS continues to 
develop QAPI plans, it should identify opportunities to focus these plans on smaller 
hospitals and patient groups at higher risk of harm. 
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APPENDIX A 





Methodology for Identifying Events and Determining 
Preventability 


We conducted a two-stage medical record review to identify adverse events and 
temporary harm events experienced by patients in our sample. In the first stage, one 
of three registered nurses (referred to as “nurse-screeners”) identified possible patient 
harm events during the IHS hospital stays and flagged the medical records of those 
patients. Records flagged by nurse-screeners were reviewed in the second stage of 
the medical record review. The second stage included comprehensive medical record 
reviews conducted by one of the six contracted physicians. Every record was reviewed 
by a nurse-screener and, if flagged, reviewed by a physician. 


Using patient characteristics and diagnosis codes, we grouped patients into one of 
four categories at the time of sample selection: labor and delivery (regardless of age), 
pediatrics (aged up to 17), adults (aged 18 to 64), and older adults (aged 65 and 
older). Pediatric patients and labor and delivery patients were assigned to physicians 
with specialized experience with those demographics. Additionally, one 
nurse-screener who is a perinatal expert was responsible for screening all labor and 
delivery cases. 


Stage One: Nurse Screening 


To identify patients who were likely to have experienced events during their stays, 
nurse-screeners reviewed medical records for the IHS hospital stays using a trigger 
tool. The protocol required nurse-screeners to look for “triggers” that indicate 
possible patient harm. 


A trigger is a clinical clue (e.g., a laboratory test showing low blood glucose, or a 
patient care event such as a fall) that requires the nurse-screener to explore the 
medical record to determine whether adverse or temporary harm events likely 
occurred. It could be the harm itself, such as a pressure injury, or a reference that 
indicates possible harm, such as transfer to a higher level of care. Three registered 
nurses used different trigger tool modules to review medical records depending on 
the patient's age and reason for admission (e.g., labor and delivery). (See Appendix C 
for a list of the triggers used to identify events.) 


> Adult and older patients—Nurse-screeners used a modified version of the 
Institute for Healthcare Improvement's (IHI's) Global Trigger Tool (GTT) to 
review all adult patients (aged 18 and over). This tool includes triggers in 
five categories: patient care, intensive care, medication, surgery, and 
long-term/non-acute-care. The long-term/non-acute triggers were included 
to facilitate identification of harm in patients who remained in an IHS hospital 
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after they no longer required inpatient acute care, as IHS patients may be 
admitted or have their stay extended for social reasons or if there is not a 
post-acute-care facility nearby. The triggers were selected from among those 
developed for OIG studies of adverse events in post-acute-care settings. 


> Labor and delivery patients—For labor and delivery patients, nurse-screeners 
followed the same OlG-modified GTT as was used on adult patients. An 
additional module of perinatal triggers was also incorporated. The perinatal 
triggers were drawn from the IHI free-standing Perinatal Trigger Tool with 
some additional triggers suggested by OlG-contracted clinicians who are 
experts in perinatal trigger tools. 


» Pediatric patients—For pediatric patients, nurse-screeners used the OIG's 
modified Global Assessment of Pediatric Patient Safety (GAPPS) Trigger 
Tool.*** This tool was developed by the Center of Excellence for Pediatric 
Quality Measurement and funded by AHRQ and CMS pediatric quality 
programs.'" This tool includes triggers in six categories: medications/fluids, 
hospital care environment, health care-associated infections, 
transfer/outcomes, surgery, and neonatal/pediatric intensive care. A seventh 
module of long-term/non-acute triggers was added to better recognize harm 
in pediatric patients who remained in an IHS hospital after they no longer 
required acute-care services. In addition, we modified the tool for consistency 
with other OIG reviewer guidance, such as including Stage 1 pressure injuries 
as adverse events and not including adverse events that were present on 
admission. 


For each possible event, the screeners recorded a description of the event, the level of 
harm, and relevant evidence in the medical record. Using the GTT methodology, 
nurse-screeners flagged 57 admissions for referral to the second stage of review and 
also requested checks for an additional 24 in which they did not identify likely patient 
harm but found that the case included complexities that warranted additional review. 
Altogether, nurses flagged 81 of the 457 admissions in the sample for the second 
stage of review. The flagged admissions could include more than one possible event. 


The screening process enabled us to reduce the number of records requiring 
second-level review of the full medical records by a physician. As in the other OIG 
studies of adverse event incidence, physician-reviewers indicated that the results of 
the stage-one screening helped them to readily identify potential events for 
consideration. 


Stage Two: Physician Review 


One of six physicians reviewed the medical records for each of the 81 admissions 
flagged by the nurse screeners. As part of our quality assurance process, physicians 
reviewed an additional 100 admissions that were not referred by nurses. Altogether, 
physicians reviewed 181 admissions. 
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Physicians conducted comprehensive reviews of the medical records. The 
physician-reviewers used the medical records, nurse-screener results, and a summary 
of the encounter data from IHS's National Data Warehouse to facilitate their reviews. 
They independently identified adverse events and temporary harm events and also 
confirmed or dismissed the possible harm events flagged by the screeners in the first 
stage of review. For each event identified, the physician-reviewers followed a 
structured protocol that required them to describe the event, the relevant evidence in 
the medical record, the level of harm experienced by the patient (i.e., severity), and 
whether the event was preventable. When an initial event caused a series of related 
events, physicians collapsed the events into a “cascade” and counted it as a single 
event. For labor and delivery adverse events, physicians identified events that 
occurred in the delivery room as attributable to the mother’s care and not that of the 
newborn. 


The physician-reviewers represented a variety of specializations and experience 
including cardiology, infectious disease/internal medicine, orthopedics, 
neurology/physical medicine and rehabilitation, pediatrics, and obstetrics-gynecology. 
All of the physician-reviewers were experienced with trigger tools. Four of the six had 
served as physician-reviewers in prior OIG studies of adverse events. In addition, our 
obstetrician-gynecologist was an expert in the perinatal trigger tool and our 
pediatrician was one of the developers of the GAPPS Trigger Tool. 


Assessment of Severity. As in prior OIG studies, physician-reviewers assigned each 
event to one of five levels of harm using a modified version of the NCC MERP Index. 
We distinguished between “adverse events” (levels F through I on the index) and 
“temporary harm events” (level E on the index) to separately identify events that were 
more likely to affect cost and length of stay. In addition, we sometimes use the term 
“patient harm events” as a combination of both adverse events and temporary harm 
events because both types represent harm resulting from medical care (see Exhibit 6 
on page 12). 


Assessment of Preventability. Physicians assigned each event to one of five 
preventability determinations and identified one or more factors that contributed to 
each event. (See the five-point scale in Exhibit A-1 on the next page.) Physicians also 
selected a rationale for each determination based on a list of 25 contributing factors 
gleaned from prior research and experience in OIG studies of adverse events. 1"? 
Because physicians identified many factors, we present only the most common 
contributing factors in our analysis rather than an exhaustive list of each factor. 


Contributing factors varied depending on the circumstances of each event. For 
example, preventable events may be related to substandard treatment, medical error, 
and inadequate monitoring depending on the factors involved. Nonpreventable 
events may be related to a patient's diagnosis or treatment being unusual or complex 
and thereby making care difficult, or a patient being highly susceptible to harm 
because of poor health. These factors are not necessarily exclusive of each other and 
their definitions are often subjective. For example, substandard care generally refers 
to the failure to adhere to professional standards of practice in the delivery of care, 
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but practitioners may not always agree on what this includes, and their determination 
depends on the strength of the evidence available to substantiate whether a patient 
received substandard care. 


As a result, preventability determinations are necessarily subjective and required the 
physicians to use clinical experience and judgment. Physicians based decisions on the 
circumstances of the specific case and also considered accepted standards of care; the 
expected frequency of certain events; guidance developed during the review process; 
and group discussion of the patients and events. Physicians were allowed to choose 
multiple contributing factors for the rationale behind their determinations. 


Assessing an event as clearly preventable or clearly not preventable required a greater 
degree of certainty on the part of the reviewer. The expanded scale enabled 
physicians to make more precise determinations, while our primary statistics collapse 
clearly and likely into the larger categories of preventable or not preventable. 


Exhibit A-1: Preventability Determinations 


Preventability determination Description 





Clearly preventable 


Patient harm could definitely have been avoided through improved 
assessment or alternative actions. 





Likely preventable 


Patient harm could have been avoided through improved assessment 
or alternative actions. 





Likely not preventable 


Patient harm could not have been avoided given the complexity of the 
patient's condition or the care required. 





Clearly not preventable 


Patient harm could definitely not have been avoided given the 
complexity of the patient's condition or the care required. 





Unable to determine 


Physicians were unable to determine preventability because of 
incomplete documentation or case complexity. 





Efforts To Improve Consistency and Quality of Reviews 


To promote consistency and accuracy across reviews, we issued a study-specific 
guidance document for improved decision-making, we provided training to all 
reviewers, we facilitated consensus calls with the physician-reviewers, and we 
conducted quality assurance reviews. 


Guidance Document. We provided reviewers with a guidance document that 
included event definitions and considerations for specific types of events and 
included a list of frequently asked questions. We created the guidance document to 
align with clinical research literature; professional and government guidelines (such as 
evidence-based practices); decisions made in prior OIG studies; and consultations 
with subject-matter experts. The document also provides instructions that are 
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applicable to a wide range of events, including how to assess event timing, underlying 
disease, related events, and recurring events: 


> Present on admission—We excluded events that occurred before the patient 
entered the IHS hospital or that were attributable to care provided prior to 
admission. 


> Underlying disease—We excluded events that were part of the underlying 
disease process unless there was an omission of care resulting in an 
exacerbation of the underlying disease. 


> Related events—When an initial event caused a series of related and 
dependent events, we combined the events into a “cascade” event and 
counted it as a single event. 


> Recurring events—When an event recurred during an IHS hospital stay 
(e.g., two episodes of hypoglycemia), we considered the timeframe and the 
circumstances of the event. We counted recurring events as a single event if 
they happened under similar circumstances or were less than 7 days apart. 
We counted them as separate events if the circumstances that led to the 
events were substantially different and the events were more than 7 days 
apart." 


Training. We provided two trainings for each reviewer regarding the OIG 
methodology for identifying and classifying adverse and temporary harm events. The 
training included a review of the guidance document and an explanation of the 
protocol questions. Each reviewer also performed pre-test reviews and received 
feedback on the results of those reviews. 


Consensus Calls. We facilitated regular conference calls to further promote 
consistency across physician-reviewers. During these calls, physician-reviewers 
discussed events that were complex, difficult to assess, involved issues outside their 
area of expertise, or had possible implications for other cases. Once physicians 
completed the medical record reviews, we held one additional call, during which 
physicians reviewed subsets of events to ensure that the event determinations and 
classifications of severity and preventability were made in a manner consistent with 
other similar events. The goal of these calls was to reach consensus and to establish 
consistency among the reviewers. 


Quality Assurance Reviews. We compared the identified events, harm-level 
determinations, and preventability determinations across groups and looked for 
deviations from our physician guidance document. We also conducted separate 
quality assurance reviews and discussed any inconsistencies with the reviewers. These 
included re-reviews of readmissions and admissions involving patient deaths, as well 
as re-reviews to check for missed events. 
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APPENDIX B 





Glossary of Selected Terms 


Adverse event—Harm to a patient as a result of medical care or in a health care 
setting, including the failure to provide needed care. (Adverse events are Levels F 
through | on the OIG-modified NCC MERP Index.) 


Atrial fibrillation—A quivering or irregular heartbeat that can lead to blood clots, 
stroke, heart failure, or other heart-related complications. 


Cardiac arrhythmia—An irregular heart rate or rhythm. 


Cascade—A chain of events initiated by an unexpected result or other incident that 
may result in patient harm. 


Cellulitis—Spreading inflammation of tissue, most commonly the skin, caused by a 
bacterial infection. 


Delirium—Mental disturbance characterized by acute confusion, disordered speech, 
and hallucinations. 


Hypercalcemia—A condition in which the blood contains an unusually high level of 
calcium. 


Hypermetabolism—An abnormal increase in the metabolic rate (i.e., an abnormal 
increase in the body's cellular chemical activity). 


Hypertension—Condition of abnormally high blood pressure. 
Hypoglycemia—Condition of abnormally low-level blood sugar (glucose). 
Hypotension—Condition of abnormally low blood pressure. 


Interstitial nephritis—A kidney disorder characterized by swelling in between the 
kidney tubules. 


Ketoacidosis—A severe diabetic complication that occurs when the body produces 
high levels of acids in the blood due to the body’s rapid breakdown of fat as fuel. 


Opioid—A class of drugs most-often prescribed to treat moderate to severe pain, 
notable for their addictive potential. 


Patient harm event—Any harm to a patient as a result of medical care. This term 
encompasses both adverse events (Levels F through | on the OlG-modified NCC MERP 
Index) and temporary harm events (Level E on this index). 


Perinatal—The time period immediately before or after birth, typically within a 
number of weeks. 
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Postpartum hemorrhage—Excessive bleeding immediately following birth, 
characterized by a decrease in blood pressure, an increase in heart rate, and a 
decrease in red blood count. 


Preeclampsia—A pregnancy complication characterized by unusually high blood 
pressure and protein in the urine. 


Tachysystole—Excessive contractions of the uterus during labor and delivery. 


Temporary harm—Harm to a patient that required intervention but did not cause 
lasting harm. Classified as Level E on the OlG-modified NCC MERP Index. 


Urinary retention—Difficulty urinating and completely emptying the bladder. 
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APPENDIX C 





Trigger Tool Used To Screen for Patient Harm Events 


For this study, OIG and its contracted clinical consultants developed and used 
different trigger tools specific to IHS hospital stays based on the IHI GTT and the 
GAPPS Trigger Tool. To develop these trigger tools, we reviewed and selected 
triggers from the IHI GTT, GAPPS Trigger Tool, and from among the triggers that were 
included in prior OIG studies. We chose triggers that the clinicians determined to be 
most applicable to different types of IHS hospital stays. 


We used the OIG-modified GTT to review adult (aged 18 to 64), older adult (aged 65 
and older), and labor and delivery (regardless of age) patient records (see Exhibit C-1). 
Perinatal triggers (included below) were used only for labor and delivery patients. For 
pediatric patients, we used the OIG-modified GAPPS Trigger Tool to review records 
for patients up to and including 17 years of age at admission (see Exhibit C-2). 


Exhibit C-1: OIG-Modified Trigger Tool Worksheet for Adult and Labor and Delivery Patients 


Care Triggers Care Triggers (continued) 








C1 Acute mental status change C17 Any procedure complication 
C2 Transfusion or use of blood products C18 Urinary retention 
c3 Code; cardiac or pulmonary arrest; or rapid C19 Neworcetdiarhea 


response team activation 
C4 Positive culture C20 Prolonged constipation 
Studies for emboli, pulmonary embolus (PE), or 
deep vein thrombosis (DVT), such as D-Dimer, 
CT pulmonary angiogram (CTPA), or lung 


ventilation-perfusion scan 
C6 Death Intensive Care Unit Triggers 


C5 C21 Care—other 























C7 Drop in hemoglobin/hematocrit 11 Pneumonia onset 

C8 Patient fall or other trauma 12 Readmission to intensive care 

C9 Pressure injuries or other skin breakdown 13 In-unit procedure 

C10 Readmission within fiscal year 2017 14 Intubation/reintubation 

C11 Restraint use I5 Intensive care unit—other 

C12 Healthcare-associated infections Medication Triggers 

C13 Tolar white: bined cals WEG) <2 000101 M1 Clostridioides difficile positive stool 
> 12,000) 

C14 New or increased diuretics M2 Abnormal electrolytes 





Hospital stroke or transient ischemic attack 
(TIA) at IHS hospital 


C16 Transfer to higher level of care M4 International normalized ratio (INR) >6 


C15 M3 Partial thromboplastin time >100 seconds 
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Medication Triggers (continued) Perinatal Triggers (continued) 


M5 


dextrose supplement 


M6 


dialysis 


Glucose < 50, glucagon or dextrose 
supplement 


For newborn infants (and other pediatric 
patients), glucose <40 mg/dl during first year of 
life; and <50 mg/dl after first year, glucagon or 


Rising serum creatinine, decreasing urine 
output, glomerular filtration rate (GFR), or acute 


P9 


P10 





Instrumented delivery 


General anesthesia 




































































M7 Vitamin K administration (phytonadione) P11 Cord gases ordered 

M8 Diphenhydramine use P12 Gestational diabetes 

M9 Flumazenil use P13 Terbutaline administration 
Administration of uterotonic agents (such as 

M10 Naloxone use P14 methylergonovine, and 15-methyl-prostaglandin 
in the postpartum period) 

M11 Antiemetic administration P15 Corticosteroid administration 

M12 Sodium polystyrene (kayexalate administration) | P16 labetalol, Hyaralazime Sr nilealpinie 
administration 

M13 Abrupt onset hypotension P17 Unplanned Caesarean section 

M14 Abnormal drug levels P18 Perinatal—other 

M15 Abrupt medication stop gge 

M16 Thrombocytopenia S1 Return to surgery 

M17 Use of traditional herbs, rituals, or botanicals S2 Change in surgical procedure 

M18 Medication—other s3 Unplanned admission to intensive care post- 
operation 

; E Intubation/reintubation/ 

LES oH bipap in post-anesthesia care unit (PACU) 

P1 Delivery prior to 39 weeks gestation S5 Unplanned X-ray intra-op or in PACU 

P2 Apgar <7 at 5 min. S6 Intra-op or post-op death 

Admission to neonatal intensive care unit : Dag 
P3 (NICU) >24 hours S7 Mechanical ventilation >24 hours post-op 
j ine : ne A Pea j 

P4 Transfer to a higher level of care S8 aa 2 epinephrine norepinephrine, naloxone 
or flumazenil 
Abnormal postoperative troponin level, 

P5 3rd or 4th degree lacerations S9 including highly sensitive troponin T (hs-cTnT), 
above the upper limit of normal 

P6 Prolonged fetal heart rate decelerations S10 Removal, injury, or repair of organ 

P7 Platelet count <50,000 S11 Any operative complication 

P8 Specialty consult (Intentionally blank) 
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Long-term/Non-acute Care Triggers 


Long-term/Non-acute Medication Triggers 





Antibiotics started while in long-term or non- 











LT-C1 Insertion or use of urinary catheter LT-M1 
acute status 
LT-C2 Acute deterioration while in long-term or non- LT-M2 Starting or increasing pain medication needs 
acute status while in long-term or non-acute status 
LT-C3 Diagnostic radiology or imaging studies while LT-M3 Administration of parenteral fluid while in long- 
in long-term or non-acute status term or non-acute status 
ied nr ere <cther LT-M4 Long-term/non-acute care medication module— 





other 





Exhibit C-2: OIG-Modified GAPPS Trigger Tool 





Medications/Fluids Triggers 


Hospital Care Environment Triggers (continued) 




















Ped_M1 Warfarin triggers: INR >6 Ped_H5  Embolus/thrombus documentation 
Ped_M2 Serum creatinine doubling Ped_H6 Pediatric hospital care environment—other 
Nephrotoxin use (e.g., aminoglycosides, 
Ped_M3 cyclosporine, tacrolimus, vancomycin) and Healthcare-associated Infection Triggers 
doubling creatinine (Cr) 
Elevated omg eve le (aritiepile ptic?) Positive Clostridioides difficile test 
Ped_M4 phenytoin (>30 mcg/ml) or abnormally low | Ped_I1 in a 
(>4" calendar day from admission) 
(<10 mcg/ml) 
Elevated drug levels (antiepileptics): 
Ped_M5 oxcarbazepine (>45 mcg/ml) or abnormally | Ped_I2 Oral vancomycin 
low (<3 mcg/ml) 
Ped_M6 Total bilirubin >25 mg/dl (<28 days old) Ped_|3 Positive blood culture 
Ped M7 Hepatotoxic medications and elevated liver Ped |4 Positive ütine:cultüre 


enzymes (AST, ALT) >3 x normal 


Hypoglycemia < 40 mg/dl during the first 


Positive respiratory or gastrointestinal (GI) 









































Ped_M8 year of life; <2 mmol/L or 50 mg/dl) after Ped_I5 viral infection (on or after the 3" calendar day 
the first year of life from admission) 
Ped_M9 Abrupt medication stops Ped_l6 Surgical site infection 
Ped_M10 Flumazenil administration Ped_I7 Healthcare-associated infection module—other 
Ped_M11 aia ay vin Hospital Transfer/Outcomes Triggers 
intermittent laxative use 
Ped_M12 Naloxone administration Ped_T1 Readmission within fiscal year 2017 
Ped_M13 Pediatric medication—other Ped_T2 Any pode PAESE ATAI tesponse EAr 
activation 
Hospital Care Environment Triggers Ped_T3 All inpatient deaths 
Ped_H1 Patient fall Ped_T4 Hospital transfer/outcomes module — other 
Infiltrations: infiltration/extravasation or 
Ped_H2 e i , gge 
phlebitis documentation 
Ped_H3 Infiltrations: hyaluronidase administration Ped_N1 Peadmisaon a 
discharge/transfer 
Ped_H4 Pressure injury documentation (> Stage 1) Ped_N2 Transfer to higher level of care 
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NICU/PICU Triggers (continued) Surgical Triggers (continued) 
Ped_S7 









Unplanned endotracheal extubating Pediatric surgical module—other 





Failed endotracheal extubation 
Ped_N4 (reintubation within 24 hours of planned Long-term/Non-acute Care Triggers 

extubation) 

Racemic epinephrine administration 














Ped_N5 (patients mechanically ventilated within last | LT-C1 Insertion or use of urinary catheter 
24 hours) 

Ped N6 NICU/Pediatric intensive care unit (PICU) LT-C2 Acute deterioration while in long-term or non- 
module—other acute status 

Surgical Triggers LT-C2 LT-C3 
Drop of hemoglobin (Hgb) or hematocrit 

Ped_S1 (Heb rofs25% in less than 24 hours LT-C4 Long-term/non-acute care—other 

Ped_S2 AEN a VE e R Long-term/Non-acute Medication Triggers 


postoperatively 
Operative time >6 hours (non-cardiac 





Antibiotics started while in long-term or non- 


patients) acute status 


Ped_S3 LT-M1 


Intraoperative epinephrine, norepinephrine, Starting or increasing pain medication needs 








BEEN or phenylephrine (non-cardiac patients) EM while in long-term or non-acute status 

Ped_S5 Renie surgen LT-M3 Administration of parenteral fluid while in 
long-term or non-acute status 

Ped S6 Change inprocedure LT-M4 Long-term/non-acute care medication 


module—other 
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APPENDIX D 





Estimates, Confidence Intervals, and Key Statistics 


The estimates included in this report are based on a sample of 384 patients admitted 
to IHS hospitals during FY 2017. We also provide estimates of incidence rates for IHS 
hospitals in the Great Plains Area, IHS hospitals in all other Areas, small IHS hospitals 
(those with less than 1,000 admissions in FY 2017), and large IHS hospitals (those with 
1,000 or more admissions in FY 2017). These estimates were weighted by the six 
strata in our sample. However, given the small number of patient harm events, we 
were unable to provide reliably projectable estimates for each preventability 
classification, harm level, event category, and for certain event details. (See 

Appendix E for sample counts related to these analyses). See Exhibit D-1 for 
patient-level statistics for all of IHS and Exhibit D-2 for selected patient-level statistics 
for the hospitals in the Great Plains Area, hospitals outside the Great Plains Area, small 
hospitals, and large hospitals. 


Exhibit D-1: Patient-Level Estimates, Confidence Intervals, and Key Statistics for the Population 
of Patients in IHS Hospitals (n=384) 


95-Percent 95-Percent 
Confidence Interval : Confidence Interval* 
Estimated 
Sample Percentage Lower Upper Number of Lower Upper 
Estimate Description Size (n) of Patients Bound Bound Patients Bound Bound 


Events Experienced by All Patients 


At least one adverse or 























384 12.6% 8.9% 17.5% 1,840 1,216 2,465 
temporary harm event 
At least one adverse event 384 4.5%' 2.4% 8.2% 649 245 1,054 
a nope harm 384 9.4% 63% 137% 1,369 834 1,905 
An adverse event only 384 3.2% 1.5% 6.7% 471 121 821 
A temporary harm event only 384 8.2% 5.3% 12.3% 1,191 692 1,690 
Aibadvel se event ana 384 1.2% 0.4% 3.9% 178 sE 389 
temporary harm event 
PEVARAD aoveteerey E> Or 384 7.3% 46% 11.5% 1,070 577 1,563 
temporary harm events 
Preventable adverse events 384 3.6% 1.8% 7.0% 525 168 882 
ore temporary Aann 384 4.6% 2.5% 8.3% 669 269 1,070 
P reventab ie empora nam 384 3.7% 1.9% 7.0% 545 193 897 
events only 
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Continued from previous page 





Adverse events or temporary 

harm events resulting in 384 0.5% 0.2% 1.4% 71 =- 146 
transfer 

A cascade adverse event or 

temporary harm event 

Source: OIG analysis of IHS hospital stays for 384 patients in FY 2017. 


*Given the small proportions, confidence intervals for projected totals exceed 30-percent relative precision. 
tThis estimate rounds to 4 percent in the report because its value is 4.4502. 





384 1.9% 0.7% 5.1% 281 1 561 





Exhibit D-2: Patient-Level Estimates, Confidence Intervals, and Key Statistics for Patient 
Populations in the Great Plains Area, Outside the Great Plains Area, in Small Hospitals, and in 
Large Hospitals (n=384) 




















95-Percent 95-Percent 
Confidence Interval 7 Confidence Interval* 
Estimated 

Sample Percentage Lower Upper Number of Lower Upper 
Estimate Description Size (n) of Patients Bound Bound Patients Bound Bound 

Events Experienced by Patients in Hospitals in the Great Plains Area 
ea. 187 14.4% 9.7% 21.0% 352 216 487 
At least one adverse event 187 2.9% 1.0% 8.1% 70 -- 145 
a pe tempora kanm 187 12.6% 8.3% 18.7% 308 182 435 
An adverse event only 187 1.8% 0.5% 6.1% 44 == 98 
A temporary harm event only 187 11.5% 7.5% 17.2% 282 165 398 

| 

a ae 187 9.9% 59% 16.0% 242 122 362 
Preventable adverse events 187 2.9% 1.0% 8.1% 70 -- 145 
pao tempora aun 187 7.0% 3.9% 12.2% 172 75 269 
oi Esopo ra naar 187 7.0% 3.9% 12.2% 172 75 269 


Events Experienced by Patients in Hospitals Outside the Great Plains Area 





At least one adverse or 














temporary harm event 197 12.3% 8.1% 18.2% 1,489 879 2,098 
At least one adverse event 197 4.8% 2.4% 9.3% 579 181 977 
o eee 197 8.7% 53% 141% 1,061 540 1,582 
A temporary harm event only 197 7.5%" 44% 12.6% 909 425 1,394 
al Ss aoe 197 6.8% 3.8% 12.0% 828 350 1,306 
Preventable adverse events 197 3.7% 1.7% 7.9% 455 106 804 
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Continued from previous page 





Preventable temporary harm 





197 4.1% 1.9% 8.8% 497 109 886 
events 
ema ota Nam 197 3.1% 1.2% 7.5% 373 35 711 
events onl 


Events Experienced by Patients in Small Hospitals’ 


At least one adverse or 

















ada 236 18.5% 13.5% 24.9% 708 491 925 
At least one adverse event 236 4.7% 2.3% 9.4% 180 54 307 
a one tempora harm 236 15.2% 10.7% 21.2% 582 384 781 
A temporary harm event only 236 13.8% 9.6% 19.5% 528 340 716 
E A = 236 9.2% 5.8% 14.3% 353 195 511 
Preventable adverse events 236 4.0% 1.8% 8.4% 153 37 269 
e mara anm 236 5.9% 3.4% 10.1% 227 105 349 
te e temporary harm 236 5.2% 3.0% 9.0% 200 89 311 








Events Experienced by Patients in Large Hospitals’ 


At least one adverse or 














147 9.4% 5.3% 16.0% 1,008 451 1,566 
temporary harm event 
At least one adverse event 147 4.1% 1.7% 9.5% 442 61 823 
nti AA 147 6.4% 3.2% 12.3% 690 225 1,154 
A temporary harm event only 147 5.3% 2.5% 10.9% 566 141 991 
Preventable adverse events or 147 5.5% 2.6% 11.1% 593 165 1,021 
temporary harm events 
Preventable adverse events 147 3.2% 1.2% 8.3% 345 11 679 
ha eae fempetaly Naim 147 3.2% 1.2% 8.3% 345 11 679 
Preventable temporary harm 147 2.3% 0.7% 6.9% 248 E 525 
events only 





Source: OIG analysis of IHS hospital stays for 384 patients in FY 2017. 

*Given the small proportions, confidence intervals for projected totals exceed 30-percent relative precision. 

+This estimate rounds to 7 percent in the report because its value is 7.4882. 

+For one patient with two hospitalizations during the year, one admission was ineligible for this particular analysis because the patient did not receive 
acute-care services. As a result, the n here is 383 rather than 384 patients. 
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APPENDIX E 





Sample Numbers by Patient and Event Type per Stratum 


Our patient-level and event-level sample numbers and percentages are based on a 
sample of 384 patients admitted to IHS hospitals during FY 2017. We are unable to 
reliably project certain sample numbers, so we instead present evidence of the sample 
frequencies by patient and event type per the six strata (numbered from 1 to 6). See 
Exhibit 5 on page 11 for the patient population and sample sizes in each stratum. 


Patient type is distinguished by adult (aged 18 to 64), older adult (aged 65 and older), 
pediatric (those up to and including 17 years of age), and labor and delivery 
(regardless of age). Event type includes severity (on the OlG-modified NCC MERP 
Index), preventability, and clinical category (medication, patient care, infections, and 
procedures). 


Exhibit E-1 shows the number of patients in our sample, the number of patients who 
experienced harm events, and the number of events by patient type per stratum. 
Exhibit E-2 shows the number of events by patient type and clinical category. 

Exhibit E-3 shows the number of events by event type (e.g., severity, clinical category, 
and preventability) per stratum. Exhibit E-4 shows the number of events by clinical 
category and subcategory per stratum. 


Exhibit E-1: Number of Patients, Number of Patients Who Experienced Harm Events, and 
Number of Events by Patient Type per Stratum (n=384) 

















Stratum 

Patient Type Total (1) (2) (3) (4) (5) (6) 
Patients in Sample 

Adults* 194 27 16 22 38 49 42 
Older Adults 61 1 7 7 9 26 11 
Labor and Delivery 48 11 9 4 0 6 18 
Pediatric 81 11 8 7 10 19 26 
Total Patients 384 50 40 40 57 100 97 
Patients Who Experienced Harm Events 

Adults 29 5 3 3 7 8 3 
Older Adults 18 0 1 2 2 10 3 
Labor and Delivery 10 0 4 1 0 1 4 
Pediatric 4 0 0 1 3 0 0 
Total Patients Who 61 5 8 7 12 19 10 


Experienced Harm Events 
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Continued from previous page 





Events in Sample 





















Adults 34 8 5 3 7 8 3 
Older Adults 29 0 2 2 4 13 8 
Labor and Delivery 12 0 4 1 0 1 6 
Pediatric 4 0 0 1 3 0 0 
Total Events 8 





Source: OIG analysis of IHS hospital stays for 384 patients in FY 2017. 
*We do not count as adults two patients who had initial stays as labor and delivery patients and subsequent stays as adult patients. 


Exhibit E-2: Number of Events by Patient Type and Clinical Category (n=384) 


Clinical Category 


Total 
Patient Type Events Medication Patient Care Infections Procedures 





Events in Sample 


Adults 34 22 10 1 1 























Older Adults 29 15 9 4 1 
Labor and Delivery 12 3 7 1 1 
Pediatric 4 1 0 0 
Total Events 79 41 29 6 3 
Source: OIG analysis of IHS hospital stays for 384 patients in FY 2017. 
Exhibit E-3: Number of Events by Event Type per Stratum (n=384) 

Total Stratum 
Event-level Description Events (1) (2) (3) (4) (5) (6) 
Events in Sample 
Adverse and temporary harm events 79 8 11 7 14 22 17 
Adverse events 19 3 0 1 2 7 6 
Temporary harm events (E-level harm) 60 5 11 6 12 15 11 
Cascade temporary or adverse events 7 1 2 0 1 1 2 
Transfer to an acute-care hospital because of an 5 1 0 1 > 1 0 


adverse or temporary harm event 
Severity Level on NCC-MERP for Adverse Events 


F-level harm—An event that resulted in a 








prolonged stay or became primary reason for 13 2 0 1 2 5 3 
treatment 
G-level harm—An event that contributed to or 1 0 0 0 0 0 1 


resulted in permanent patient harm 
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H-level harm—An event that required 
intervention to sustain the patient's life 





|-level harm—An event that contributed to 
death 


Clinical Category for Adverse Events and Temporary Harm Events 


Medication-related adverse and temporary 
harm events 





Patient-care-related adverse and temporary 
harm events 





Infection-related adverse and temporary harm 
events 





Procedure-related adverse and temporary harm 
events 





7 9 
11 4 
2 3 
2 1 


Preventability Classification for Adverse Events and Temporary Harm Events 


Adverse and temporary harm events that were 
preventable 





Adverse and temporary harm events that were 
not preventable 





Adverse and temporary harm events—unable to 
determine 





Adverse events that were preventable 


Adverse events that were not preventable 





Temporary harm events that were preventable 


Temporary harm events that were not 
preventable 





10 8 
11 9 
1 0 
6 3 
1 3 
4 5 
10 6 





Source: OIG analysis of IHS hospital stays for 384 patients in FY 2017. 
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Exhibit E-4: Number of Events by Clinical Category and Subcategory (n=384) 


Stratum 


Adverse Events and Temporary Total 
Harm Events by Clinical Categor Events (1) (2) (3) (4) (5) (6) 





Medication 


Delirium/change in mental status 1 


—_ 
-à 
-à 


Hypoglycemia 


Hypotension/hypertension 


Diarrhea 


=2 O O 


2 
7 
6 
Allergic reaction 3 
3 
Tachysystole 3 
Nausea and vomiting 2 
Cardiac arrhythmia 1 
Excessive bleeding 1 


Interstitial nephritis 1 


2 OO OO OD O N 


Prolonged constipation 1 


O O O O O N O O O = N N 


Seizure 1 


Patient Care 











Infiltration from intravenous catheter 


- wu OoOO o o oOo oO oO 


Postpartum hemorrhage 


Skin tear/abrasion 


9 
4 
Pressure injury 3 
3 
Fluid/electrolyte disorders 2 

2 


Hypotension 


- Oo O O =œ O wuk- o O ~ O O O O N O 


Allergic reaction 1 
Diabetic ketoacidosis 

Exacerbation of abnormal liver condition 

Fall 


Oxygen desaturation 


Hypertension/preeclampsia 







Infections 





Surgical site infections 





Procedures 


1 
1 
1 
1 
1 
y | 
Soft tissue infections 4 
2 
3 
Atrial fibrillation 1 
1 


Laceration 


o o o kef o o keo o o o o oOo O ~a O O = ORo o oOo O O O O a ~a a a ~a p 
= 0 0° Ben -KKH - o o o= oOo O O oO ON OBC oO BF O = O N O O =œ = U KO 


oO o o eg o - Bec Oo O O O O O O O O O O leo 
oO o o eğ o o PRH o o o o o O N O O O 
o - -pPI o no — KH O O O O 2 U N 0 Y 


oO o o eğ o o Ho o o ~ oO 


Urinary retention 1 
Source: OIG analysis of IHS hospital stays for 384 patients in FY 2017. 
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APPENDIX F 





Comparing Rates of Adverse Events and Temporary Harm 
Events to Other Health Care Settings 


We are unable to conduct a reliable comparison between the incidence rates found in 
this study and the 27 percent rate of adverse and temporary harm events found in the 
prior OIG study of adverse events among hospitalized Medicare patients. Many 
factors can affect harm rates other than the care provided. Other factors to consider 
include: 


> Differences in the population of patients reviewed—Prior OIG studies 
included only Medicare beneficiaries (typically age 65 and older) who are 
potentially more susceptible to harm; this study, in contrast, spanned the full 
range of patient ages, including children and young adults who may be less 
susceptible to harm. 


>» Differences in the type of care provided—IHS hospitals typically provide less 
complex care than other hospitals across the nation, resulting in fewer 
opportunities for potential harm. For example, a patient requiring complex 
surgery may be transferred out of the IHS system for the surgery. 


> Differences in average length of stay—Hospitalized IHS patients have shorter 
average lengths of stay than patients at other hospitals, further reducing 
opportunities for harm. 


To account for the last factor (length of stay), hospitals commonly measure adverse 
events by incidence density, which is the number of events by patient days or by 
hospital admissions to adjust for the period during which patients are observed. For 
example, incidence density is often used in measuring healthcare-acquired infections 
because risk can increase with the length of exposure to the healthcare 
environment.''® The Institute for Healthcare Improvement (IHI), a nonprofit advisory 
group to hospitals, cites advantages to using incidence density metrics over standard 
incidence rates that measure the percent of admissions with adverse events.''® IHI 
reports that measuring total events by patient days or hospital admissions also 
enables hospitals to count multiple events experienced by the same patient. 


The sample of 384 IHS hospital patients that were admitted to an IHS hospital in 

FY 2017 included 457 total hospital stays (admissions) and a total of 1,587 days in the 
hospital (patient days). We calculated patient days by subtracting the admission date 
for each IHS hospital stay from its discharge date. Using the incidence density 
measure, we found 46 patient harm events per 1,000 patient days in IHS hospitals. 
Exhibit F-1 on the next page provides the estimated ratios for adverse and temporary 
harm events per 1,000 patient days and per 100 admissions. 
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Exhibit F-1: Rates of Adverse Events and Temporary Harm Events in the Sample by Patient 
Days and Hospital Admissions (n=384) 











95-Percent 95-Percent 
Confidence Interval Confidence Interval 
Per 1,000 Lower Upper Per100 Lower Upper 
Category Patient Days Bound Bound Admissions Bound Bound 
Adverse events 14.6 6.8 22.4 5.6 2.2 9.1 
Temporary harm events 31.2 20.7 41.8 10.7 6.3 15.1 
Adverse events and 
temporary harm events 45.8 31.2 60.4 16.4 10.5 22.3 
combined 





Source: Office of Inspector General Analysis of IHS hospital stays for 384 patients in FY 2017. 


Using incidence densities from prior OIG work as benchmarks, IHS hospitals appear to 
have fewer patient harm events per 1,000 patient days than other acute-care 
hospitals, but more than post-acute-care settings (such as nursing homes), which 
typically provide less complex care. 


However, a direct comparison of the incidence density in IHS to incidence density in 
other acute-care hospital settings is not appropriate given the time gap in 
measurements and differences in the length of the review period (1 year versus 

1 month). As a result, we only present these prior rates for reference and avoid 
statistical comparisons. Exhibit F-2 shows the rates of harm events per 1,000 patient 
days for acute-care hospitals, IHS hospitals, long-term care hospitals, rehabilitation 
hospitals, and skilled nursing facilities. 


Exhibit F-2: Rates of Adverse Events and Temporary Harm Events per 1,000 Patient Days 
Across Health Care Settings 














95-Percent 
Confidence Interval 
Healthcare Setting Sample Size (n) | Per 1,000 Patient Days Lower Bound Upper Bound 
Acute-care hospitals 780 69.4 61.2 77.5 
IHS hospitals 384 45.8 31.2 60.4 
Long-term care hospitals 587 38.0 33.9 42.1 
Rehabilitation hospitals 417 29.3 24.3 34.3 
Skilled nursing facilities 653 24.3 20.4 28.1 


Sources: Office of Inspector General analysis of IHS hospital stays for 384 patients in FY 2017, long-term care hospital stays for 587 Medicare 
beneficiaries in March 2014, rehabilitation hospital stays for 417 Medicare beneficiaries in March 2012, skilled nursing facility stays for 
653 Medicare beneficiaries in August 2011, and acute-care hospital stays for 780 Medicare beneficiaries in October 2008. 
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APPENDIX G 


Agency Comments 





OA 
f j DEPARTMENT OF HEALTH & HUMAN SERVICES Public Health Service 
AS Indian Health Service 
NOV 1 0 2020 Rockville, MD 20857 
TO: Inspector General 
FROM: Director 


SUBJECT: IHS Response to Draft OIG Report, OEI 06-17-0530, “Incidence of Adverse 
Events in Indian Health Service Hospitals,” dated September 2020 


We appreciate the opportunity to provide our official comments on the Draft OIG Report, OEI 
06-17-0530, entitled, “Incidence of Adverse Events in Indian Health Service Hospitals,’ dated 
September 2020. The Indian Health Service (IHS) makes patient safety a very high priority. 
Actions taken since 2017 have created a foundation for improving patient safety across the IHS 
health care system. The rate of adverse events or temporary harm in hospitals within the 
United States (U.S.) is consistent with the OIG finding of 13 percent of patients experiencing 
adverse events or temporary harm at [HS hospitals. This rate is still unacceptable to the IHS. 
Our responses and planned actions to the three OIG recommendations are discussed below. 


Recommendation Number 1: The IHS concurs with the recommendation. 
Establish patient harm monitoring and reduction as a key priority of the Office of Quality. 


Planned and completed actions: 

The IHS recognizes the need to take steps to reduce all causes of harm to patients. Through our 
partnership with the Centers for Medicare & Medicaid Services (CMS), the IHS established 
all-cause harm reduction as one of the three priorities for the Partnership to Advance Tribal 
Health (PATH). At the CMS 2019 Quality Symposium, PATH reported that IHS had a 

34 percent reduction of the composite harm measure for health care acquired infections between 
2015 and 2019. The composite harm measure used data from CMS through the prevention in 
IHS facilities, the IHS Office of Quality (OQ) has partnered with the Centers for Disease Control 
and Prevention (CDC) National Healthcare Safety Network (NHSN). 


The IHS has worked to improve training and education related to patient safety. The IHS OQ 
established a web-based Quality Portal to provide a collaborative learning environment to 
support knowledge exchange and information-sharing among IHS hospital and health center staff 
and leadership. Since 2019, 40 patient safety-related resources have been entered into the 
Quality Portal by IHS staff. Prior to the COVID-19 pandemic response, three quarterly 
newsletters were produced by the IHS OQ and distributed IHS-wide containing, 17 articles 
regarding patient safety. 


The IHS is working to address all causes of harm. The IHS is implementing the Agency for 
Health Research and Quality’s (AHRQ) Team STEPPS program. In 2019, PATH conducted 
seven Team STEPP training sessions in five IHS area offices. To improve infection control and 
prevention in IHS facilities, we have partnered with the CDC to conduct trainings and 
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consultation. In fiscal year (FY) 2019, the IHS and the CDC held two Infection Control and 
Prevention trainings at two IHS Area offices with more than 30 IHS and Tribal participants in 
each training session. In FY 2020, the IHS and the CDC held Tele-ICAR (Infection Control 
Assessment and Response) at 45 IHS and Tribal facilities in 8 IHS Area offices to improve 
infection control practices in the COVID-19 environment. The IHS collaborated with the 
American Hospital Association (AHA) to facilitate the IHS Certified Healthcare Environmental 
Services Training (CHEST) workshop in February 2020. Training resulted in 40 IHS-Certified 
CHEST Trainers with representatives from all IHS Areas, which subsequently led to 
standardized best practice infection control EVS standards in IHS facilities. The IHS and the 
CDC sent a collaborative team that provided technical consultation to assess gaps in 
environmental infection control at five IHS health care facilities over five days in the 

Navajo Area IHS. 


The IHS National Pharmacy and Therapeutics Committee (NPTC) established the 
pharmacovigilance program to provide clinicians with knowledge, tools, and resources to reduce 
the risks associated with medication therapy in an effort to promote safe and rational use. The 
Pharmacovigilance program established a Web site to provide information to clinicians. Since 
FY 2019, the program has disseminated 11 drug safety communications and 15 drug safety 
alerts. In FY 2020, to address COVID-19, the IHS NPTC drafted and disseminated 7 drug safety 
alerts, 15 guidance documents for therapeutic use, and held 2 training and planning exercises for 
COVID-19 treatment scenarios and vaccine use. 


The National Committee on Heroin Opioids and Pain Efforts (HOPE) Committee has addressed 
harm reduction related to opioid use. The HOPE Committee hosted a syringe service program to 

- reduce site infections and recruited and renewed IHS Area Naloxone Mentors to improve 
appropriate Naloxone use. The HOPE Committee is publishing a blog on their Web site to 
disseminate promising practices to address opioid use disorders. 


Recommendation No. 2: The IHS concurs with this recommendation. 
Effectively track and monitor patient harm events using an improved incident reporting system. 


Planned and completed actions 
To effectively track and monitor adverse events, in August 2020, the IHS fully implemented the 


IHS Safety Tracking and Response (I-STAR) system to improve reporting, investigation, and 
appropriate action to mitigate potential and actual harm. The I-STAR system is implemented in 
all IHS Areas and facilities. This system monitors and tracks adverse events and provides a 
reporting capability. The IHS OQ monitors reporting from the system to determine types of 
adverse events and to address challenges in entering information into the system. As of 
October 29, 2020, the bi-weekly I-STAR report revealed that all IHS direct service facilities 
reported 4,581 events, including 2,137 that were a medication “good catch.” The I-STAR team 
has created a Web page to improve user access. The I-STAR team developed a standardized 
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report showing medication good catches and medication errors. The IHS OQ continues to work 
with Area IHS offices and facility staff to optimize the I-STAR, provide training, and improve 
data reporting. 


Recommendation No. 3: The IHS concurs with this recommendation. 


Implement quality improvement plans to improve patient safety across IHS, including plans that 
focus specifically on smaller hospitals and patient groups at higher risk of harm. 


Planned and completed actions 
IHS hospitals and Critical Access Hospitals have Quality Assurance and Performance 


Improvement (QAPI) plans completed in accordance with CMS regulations and accreditation 
standards. IHS health centers have quality improvement plans in accordance with accreditation 
standards. These QAPI and quality improvement plans include patient safety and adverse 
events. Since FY 2019, the IHS has undergone 42 CMS certification and accreditation surveys 
in our hospitals and health centers. The final reports for all of these surveys in IHS hospitals and 
health centers have resulted in full compliance. 


In 2020, the IHS established a National Compliance Program in the immediate Office of the 
Director as a component of the IHS Enterprise Risk Management Program. One of the main 
activities initiated in 2020, is to conduct IHS Headquarters oversight reviews of all IHS Area 
Offices in high-risk subject areas. One of the high-risk areas identified in 2020 is the review of 
Area Governing Body responses to accreditation findings. Governing Body minutes are 
reviewed to ensure that patient safety performance improvement measures are included in QAPI 
plans. When a suspected or potential patient safety event has occurred, the QAPI plan is 
reviewed to ensure performance improvement measures are incorporated and that evidence is 
provided in Governing Body minutes. 


Thank you for the opportunity to review and comment on this draft report. Please refer any 
follow-up questions you have regarding our comments to Ms. Athena Elliott, Chief Compliance 


Officer, IHS, by e-mail at athena.elliott@ihs.gov. 


8 ( O, “YA 
RADM Michael D. Weahkee, MBA. MHSA 
Assistant Surgeon General, U.S. Public Health Service 
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ABOUT THE OFFICE OF INSPECTOR GENERAL 





The mission of the Office of Inspector General (OIG), as mandated by Public Law 95- 
452, as amended, is to protect the integrity of the Department of Health and Human 
Services (HHS) programs, as well as the health and welfare of beneficiaries served by 
those programs. This statutory mission is carried out through a nationwide network 
of audits, investigations, and inspections conducted by the following operating 
components: 


The Office of Audit Services (OAS) provides auditing services for HHS, 
either by conducting audits with its own audit resources or by overseeing audit work 
done by others. Audits examine the performance of HHS programs and/or its 
grantees and contractors in carrying out their respective responsibilities and are 
intended to provide independent assessments of HHS programs and operations. 
These audits help reduce waste, abuse, and mismanagement and promote economy 
and efficiency throughout HHS. 


The Office of Evaluation and Inspections (OEI) conducts national 
evaluations to provide HHS, Congress, and the public with timely, useful, and reliable 
information on significant issues. These evaluations focus on preventing fraud, waste, 
or abuse and promoting economy, efficiency, and effectiveness of departmental 
programs. To promote impact, OEI reports also present practical recommendations 
for improving program operations. 


The Office of Investigations (Ol) conducts criminal, civil, and administrative 
investigations of fraud and misconduct related to HHS programs, operations, and 
beneficiaries. With investigators working in all 50 States and the District of Columbia, 
Ol utilizes its resources by actively coordinating with the Department of Justice and 
other Federal, State, and local law enforcement authorities. The investigative efforts 
of Ol often lead to criminal convictions, administrative sanctions, and/or civil 
monetary penalties. 


The Office of Counsel to the Inspector General (OCIG) provides 
general legal services to OIG, rendering advice and opinions on HHS programs and 
operations and providing all legal support for OIG's internal operations. OCIG 
represents OIG in all civil and administrative fraud and abuse cases involving HHS 
programs, including False Claims Act, program exclusion, and civil monetary penalty 
cases. In connection with these cases, OCIG also negotiates and monitors corporate 
integrity agreements. OCIG renders advisory opinions, issues compliance program 
guidance, publishes fraud alerts, and provides other guidance to the health care 
industry concerning the anti-kickback statute and other OIG enforcement authorities. 
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